JP6039407B2 - Image processing device - Google Patents

Description

  Embodiments described herein relate generally to an image processing apparatus.

  In recent years, a paper medium processing apparatus for processing a paper medium such as mail is used. This type of paper medium processing apparatus takes out paper media (hereinafter referred to as “medium”) collectively supplied to a supply unit to a conveyance path one by one at a predetermined pitch. The taken-out medium is subjected to image processing by the image processing apparatus while images on both sides of the medium are read by an optical reading device such as a camera or a line sensor during conveyance.

  For example, the image data for each medium read by the camera is continuously transmitted to the data capturing unit. In order to classify the image data of the medium received from the camera into a plurality of image processing units, the data capturing unit forms numbered image data to which a number corresponding to the reception order of the image data is given, and the number The attached image data is sent to the data transfer unit. The data transfer unit DMA-transfers the image data to the image processing unit when the image processing unit is in a receivable state. The image processing unit includes an image determination unit and a result notification unit, and processes the transferred image.

  The image determination unit detects classification information from the image data by OCR processing, and determines the detected classification information. The determination result is output to the result notification unit.

  The result notifying unit includes a communication control unit, and outputs the determination result of the classification information input from the image determining unit to the comprehensive determining unit.

  There is an appearance inspection system and an appearance inspection method for capturing detected images of a line image sensor with a personal computer equipped with an image input function, transferring the detected images to a plurality of personal computers connected via a LAN, and extracting defects with the plurality of personal computers. It is known (for example, refer to Patent Document 1).

JP 2000-356512 A

  In the above-described conventional image processing apparatus, for example, when camera data is input from the camera at 10 ms intervals, the camera data is continuously input every 10 ms, so that the camera data is processed by one image processing unit. It may be difficult to do. In that case, a plurality of image processing units are provided, and the above-described image processing is performed by the plurality of image processing units.

  However, due to variations in the processing speed of the image processing unit, the load may be concentrated on any of the image processing units, resulting in a delay in the processing speed, which may make normal processing difficult. There is.

  SUMMARY An advantage of some aspects of the invention is that it provides an image processing apparatus capable of preventing load concentration.

In order to achieve the above object, an image processing apparatus according to claim 1 of the present invention captures image data acquired from a medium conveyed at a predetermined pitch, and is captured by the data capturing unit. A plurality of image processing units for processing the image data, wherein the data fetching unit assigns a continuous data number to the image data, and the image data to which the data number is assigned is assigned to the image data. Send to multiple image processing units in parallel,
Each of the image processing units includes a storage unit that stores the image data assigned with the serial number received from the data capturing unit, an image processing unit that performs predetermined processing on the image data, and the image processing unit Transfer permission monitoring means for monitoring whether or not the next image data can be processed, a transfer right indicating that transfer of image data to the image processing means in the image processing unit is permitted, and the image processing means A transfer right acquisition means for receiving and storing a transfer right number indicating the number of image data to be transferred from another image processing unit, a transfer right and a transfer right number obtained by the transfer right acquisition means, and the transfer As a result of monitoring by the permission monitoring means, when image data can be processed, a serial number that matches the transfer right number is assigned from the image data stored in the storage means. The image data is transferred to the image processing means, and the transfer right number is incremented and transferred to the transfer right acquisition unit of the next image processing unit together with the transfer right. As a result of the monitoring by the transfer permission monitoring means, the image data Data transfer control means for transferring the transfer right and the transfer right number to the transfer right acquisition unit of the next image processing unit.

1 is a schematic configuration diagram of an image processing apparatus according to a first embodiment. The figure explaining operation | movement of the number assigning part of the data acquisition part shown in FIG. The flowchart explaining the operation | movement of the transfer possible / impossible process of the image processing part shown in FIG. The figure explaining operation | movement of the transfer right of the data transfer part shown in FIG. The flowchart explaining operation | movement of the data transfer process of the data transfer part shown in FIG. Timing chart for explaining the operation of the image processing unit according to the first embodiment. Schematic configuration diagram of an image processing apparatus according to the second embodiment.

  The image processing apparatus 100 according to the present embodiment includes a data capturing unit 20, a data transfer unit 30 (generic name of 30A, 30B,... 30N) and an image processing unit 40 (generic name of 40A, 40B,... 40N). The image processing unit 50 is a unit (generic name of 50A, 50B,... 50N).

  The data fetching unit 20 inputs detection data output from a detection unit that detects the medium P (a general term for P1, P2,...). In the present embodiment, a case where a camera (data acquisition unit) 10 is connected as a detection unit is shown. The data fetching unit (data fetching means) 20 inputs camera data (image data) acquired by the camera 10 from the medium P, assigns a serial number to each input image data, and a plurality of image processing units 50. The image data is transferred to the data transfer unit 30.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a schematic configuration diagram of an image processing apparatus 100 according to the first embodiment. The image processing apparatus 100 can be applied to, for example, a reading apparatus for sorting information such as a postal code, an address, or a barcode of a mail as a medium. In this embodiment, a case where the reading device is used in a mail processing device (not shown) will be described as an example.

  The postal processing apparatus takes out postal media P (P0, P1,...) Supplied to the supply unit one by one at a predetermined pitch to the transport path and sandwiches them by a transport belt (not shown). Transport at high speed (for example, 4 m / s). The transported medium P is transported to a detection unit that detects the medium. FIG. 1 shows a case where the medium P is detected by the camera 10. As shown in the figure, the medium P is conveyed in the direction of the arrow A at a predetermined pitch. The camera (data acquisition means) 10 detects reflected light from the upper surface of the transported medium P. In this case, the camera 10 includes a line sensor that scans in a direction (main scanning) that intersects the transport direction. The camera 10 reads the reflected image data of the entire surface of the medium when the medium P is conveyed in the direction of the arrow A (sub-scan). FIG. 1 illustrates media P <b> 0 to P <b> 2, and image data of continuous media is continuously read by the camera 10 in this way.

  The image data read by the camera 10 is transmitted to a data capturing unit (data capturing unit) 20.

  The data capture unit 20 assigns consecutive data numbers to the image data for each medium P. For example, data number 00H (hexadecimal number 00) is assigned to the image data of the medium P0 that is first conveyed and read. Similarly, 01H is assigned to the image data of the medium P1, and 02H is assigned to the image data of the medium P2.

  In this way, the image data to which the continuous data numbers are assigned is transmitted in parallel to all the data transfer units 30 (generic names of 30A, 30B,... 30N) that use the image data. The number of data transfer units 30 is set according to the amount of image data to be processed, the content of processing, the processing time set by the transport speed for transporting the medium, and the like.

  The data transfer unit 30 stores a data transfer determination unit 31 (generic name for 31A, 31B,... 31N), a DMA (Direct Memory Access) transfer unit 32 (generic name for 32A, 32B,... 32N), and image data. Storage unit 33 (generic name for 33A, 33B,... 33N).

  The data transfer determination unit 31 includes a transfer permission monitoring unit 311 (generic name for 311A, 311B,... 311N) and a transfer right acquisition unit 312 (generic name for 312A, 312B,... 312N).

  The transfer permission monitoring unit 311 monitors whether the corresponding image processing unit 40 is permitted (enabled) or not (de-enabled) data transfer from the data transfer unit 30.

  The transfer right acquisition unit 312 is provided in each data transfer determination unit 31 and acquires a transfer data number and a transfer right number. Only the data transfer unit 30 that has acquired the transfer right number can transmit the image data to which the number is assigned to the image processing unit 40.

  The image processing unit 40 (generic name of 40A, 40B,... 40N) includes an image determination unit 41 (generic name of 41A, 41B,... 41N) and a result notification unit 42 (generic name of 42A, 42B,. Image processing of the image data assigned with the data number transferred from the transfer unit 30 is performed. In the first embodiment, characters are detected (detected and cut out) based on position information in the image data, and the classification information such as the read zip code and address is determined through character recognition of the character information (image determination). Part). The determination result is output to the result notification unit 42 (generic name for 42A, 42B,... 42N). The data transfer unit 30 and the image processing unit 40 constitute one image processing unit 50. In the first embodiment, N image processing units 50 are provided.

  The result notification unit 42 transmits the determination result for each medium to the general determination unit 60 together with the data number of the medium.

  The overall determination unit 60 rearranges the determination result transmitted from the result notification unit 42 of the other image processing unit 40 and the determination result transmitted from another detection unit (not shown) in the data acquisition order (data number order) of the medium. After that, comprehensive determination is made for each medium, and final classification determination is performed.

  The determination result transmitted from the other detection unit includes, for example, a detection result related to the conveyance state of the medium such as pitch clogging and two-sheet picking. The result of these detections. When it is determined that the state is abnormal, there may be a case where an erroneous classification determination is performed. In order to prevent such erroneous determination, the comprehensive determination unit 60 performs comprehensive classification determination.

  FIG. 2 is a diagram for explaining the operation of the number assigning unit 21 of the data fetching unit 20 shown in FIG. As described above, the number assigning unit 21 assigns a number to the image data. In the first embodiment, 8 bits (bits) are secured as the number area to be assigned, and a maximum FFH (hexadecimal) value can be given. The mail processing apparatus according to the first embodiment supplies 256 (decimal) or more mails expressed in 8 bits in one process. In this case, the numbers 00H to FFH are repeatedly used. It is only necessary to prevent the medium to be conveyed from being confused with the image data of the medium. For example, it is set in advance that image data assigned 00H comes next to image data assigned FFH by the number assigning unit. If so, there is no mistake in the order of the media. Of course, it is easy to increase the number of bits in the number area according to the number of media processed in one process.

  FIG. 3 is a diagram for explaining the operation of the transfer enable / disable process of the image processing unit 40 shown in FIG. When image processing is in progress (Yes in S01), the image processing unit 40 transmits a transfer “impossible” to the transfer permission monitoring unit 311 of the data transfer unit 30 (S02).

  When the image processing unit 40 is not processing the image (No in S01), the image processing unit 40 transmits “OK” to the transfer permission monitoring unit 311 of the data transfer unit 30 (S03).

  FIG. 4 is a diagram for explaining the operation of the transfer right of the data transfer unit 30 (generic name of 30A, 30B... 30N) shown in FIG. The transfer right indicates which data transfer unit 30 can transmit the image data to the image processing unit 40 in the series of input image data.

  After the image processing apparatus 100 is powered on, the apparatus is initialized. At this time, the transfer right R is set to be acquired by the transfer right acquisition unit 1 (312A) of the data transfer unit 1 (30A). Since the image data to be processed is the first image, the transfer right number is set to 00H. Here, the transfer right number means that image data having a data number matching the transfer right number is transferred to the image processing unit 40 (details will be described later). The image data with the data number 00H is hereinafter referred to as image data D00H.

  The data transfer unit 1 (30A) that has acquired the transfer right R is assigned a number by the number assigning unit 21 of the data fetching unit 20 if the transfer permission monitoring unit 1 (311A) receives the transfer “permitted”. As for the image data received by the data transfer unit 1 (30A), among the image data stored in the storage unit 1 (33A), the image data D00 matching the transfer right number is transferred to the image processing unit 1 (40A). . After the transfer of the image data D00 is completed, the transfer right R is transferred to the transfer right acquisition unit 2 (312B) of the data transfer unit 2 (30B), and the transfer right number is also incremented and the transfer right acquisition unit 2 (312B). Forwarded to

  The data transfer unit 2 (30B) that acquired the transfer right R, if the transfer permission monitoring unit 2 (311B) receives the transfer “permitted”, receives the image data D01 having a number that matches the transfer right number as described above. Transfer to the image processing unit 2 (40B). After the transfer of the image data D01, the transfer right R and the incremented transfer right number are transferred to the transfer right acquisition unit 3 (312C) of the data transfer unit 3 (30C).

  Similarly, when n data transfer units are used, the data transfer unit n (30N) transfers the image data Dn to the image processing unit N (40N).

  FIG. 5 is a flowchart for explaining the operation of the data transfer process of the data transfer unit 30 shown in FIG. 1, and is processed by a data transfer control means (not shown). In addition, since this operation is common to the data transfer unit 1 (30A) to the data transfer unit n (30N), it will be described using generic symbols unless particularly distinguished.

  When the data transfer unit 30 determines whether or not the transfer right acquisition unit 312 has acquired the transfer right R and determines that the transfer right R has been acquired (Yes in S11), the transfer permission monitoring unit 311 It is confirmed whether or not the corresponding image processing unit 40 is performing image processing (S12).

  As a result of this confirmation, when the transfer permission monitoring unit 311 receives the transfer “permitted” when the image processing unit 40 is not performing image processing (No in S12), there is image data that matches the transfer right number. Is determined (S13).

  If there is image data that matches the transfer right number as a result of this determination (Yes in S13), the image data is transferred to the image processing unit 40 (S14-S15). On the other hand, if there is no matching data, the data transfer unit 30 has not received the image data transmitted from the data capture unit 20 for some reason. In this case, since the image transfer from the data transfer unit 30 to the image processing unit 40 cannot be performed, the process proceeds to step S18, and the transfer right R and transfer right number are transferred to the next transfer right acquisition unit 312.

  When the transfer of the image data is completed in step S14 (Yes in S15), the transfer right number is incremented (S17).

  The transfer right number and transfer right R incremented in step S17 are transferred to the next transfer right acquisition unit. (S18). By this processing, the transfer right R and transfer right number are transferred from the data transfer unit 1 to the data transfer unit 2.

  Thereafter, the process proceeds to step S11, and the same processing is performed (loop of S11 to S18).

  In step S12, when the image processing unit 40 is performing image processing (Yes in S12), the transfer permission monitoring unit 311 receives the transfer “impossible” from the image processing unit 40. In this case, since image data cannot be transferred to the image processing unit 40, the process proceeds to step S17, and the transfer right R and transfer right number are transferred to the next transfer right acquisition unit 312 (S18).

  FIG. 6 is a timing chart illustrating the operation of the image processing unit 40 according to the first embodiment. FIG. 6 illustrates the operation in the case where the number of image processing units including the data transfer unit 30 and the corresponding image processing unit 40 is three units.

  The image data D00 to D08 are image data in which the camera 10 shown in FIG. 1 detects the media P0, P1,... P8 that are conveyed at intervals of a predetermined pitch time tp (10 ms in the first embodiment). When all the image processing units 40 are processed within the transfer right period tc of the image data D01, D02,... D08, the image data D00, D01,. -Processing of D08 can be performed in order. Note that the transfer right cycle tc is a cycle in which any image processing unit acquires the transfer right when there are three image processing units, and is three times the predetermined pitch time tp shown in the figure.

  In the first embodiment, when the processing is not performed within the transfer right period tc described above, the image processing unit 40 that could not be processed is skipped, and the next image processing unit 40 processes the next image.

  The image processing unit 1 (40A) receives the image data D00 having the image number 00 transferred from the data transfer unit 1 (30A), and starts processing. This processing time is td1.

  Since the data transfer unit 1 has finished transferring the image data D00, the data transfer unit 1 increments the transfer right number corresponding to the number of the next image data to be transferred, and has the right to acquire the transfer right next together with the transfer right R. Transfer to part 2.

  When the next image data D01 is output at timing t01, the data transfer unit 2 that has acquired the transfer right R and the transfer right number confirms that the image data D01 matches the transfer right number, and then Data D01 is transferred to the image processing unit 2.

  Similarly, when the next image data D02 is output at timing t02, the data transfer unit 3 that has acquired the transfer right R and the transfer right number confirms that the image data D02 matches the transfer right number. The image data D02 is transferred to the image processing unit 3.

  Next, when the next image data D03 is output at timing t03, the data transfer unit 1 that has acquired the transfer right R and the transfer right number indicates that the corresponding image processing unit 1 is processing the image data D00. Since the image data D03 cannot be processed, the transfer right R and the transfer right number are transferred to the data transfer unit 2 having the right to acquire the transfer right R next time.

  The data transfer unit 2 receives the transfer of the transfer right R from the data transfer unit 1 and transfers the image data D03 to the image processing unit 2.

  Similarly, the image data D04, D05, D06, and D07 are transferred to the image processing units 3, 1, 2, and 3 corresponding to the data transfer units 3, 1, 2, and 3, respectively, and processed.

  When the next image data D08 is output at timing t08, the data transfer unit 1 that has acquired the transfer right is processing the image data D05 because the corresponding image processing unit 1 is processing the image data D05. Therefore, the transfer right R and transfer right number are transferred to the data transfer unit 2 having the right to acquire the transfer right R next time.

  The data transfer unit 2 receives the transfer of the transfer right R from the data transfer unit 1 and transfers the image data D08 to the image processing unit 2.

  By repeating the above processing, the image data to which the number (image number) is assigned by the number assigning unit 21 of the data fetching unit 20 is transferred to the data transfer units 1 to 3, and the image data is imaged in the order of the managed transfer data. The data is transferred to the processing unit 40 and processed.

  By performing the above processing, it is possible to prevent the load from being concentrated on a specific image processing unit 40 when the image data continuously output from the camera 10 is distributed and processed by the plurality of image processing units 40. be able to.

  FIG. 7 is a schematic configuration diagram of an image processing apparatus 200 according to the second embodiment. In the first embodiment, the data transfer unit 30 in each image processing unit 50 is provided with the transfer permission monitoring unit 311 and the transfer right acquiring unit 312. However, in the second embodiment, the image processing unit 140 (140A, 140B,. A transfer permission monitoring unit 311 and a transfer right acquisition unit 312 are provided in a generic name of 140N. Therefore, the data transfer unit 130 (a general term for 130A, 130B,... 130N) includes a data transfer determination unit 31, a DMA transfer unit 32, and a storage unit 33. Since the basic functions of the respective parts constituting the second embodiment are the same as those of the first embodiment, detailed description thereof will be omitted, and the changed portions will be described.

  The image data numbered by the data fetching unit 20 is transmitted to a plurality of data transfer units 130 arranged in parallel.

  The image processing unit 140 acquires the transfer right R and the transfer right number, and when the transfer permission monitoring unit 312 is in the transfer “permitted” state, transmits the transfer right number to the data transfer unit 130 and makes a transfer request.

  The data transfer unit 130 receives the transfer right number from the image processing unit 140, and DMA-transfers the image data matching the transfer right number to the image processing unit 140.

  The image data transferred by DMA is subjected to image processing by the image processing unit 140 as in the first embodiment, and the result is notified to the result notification unit 42.

  By performing the above processing, as in the first embodiment, when the image data continuously output from the camera 10 is distributed and processed by the plurality of image processing units 40, the load is concentrated on the specific image processing unit 40. Can be prevented. The data transfer unit 130 according to the second embodiment has a simple configuration as compared with the data transfer unit 30 according to the first embodiment, stores the image data output from the data capture unit 20 in the storage unit 33, and performs image processing. Since the image data specified at the time of the transfer request from the unit 140 may be transmitted, the versatility can be obtained when applying to other systems such as a case where a plurality of processes different in the image processing unit 140 are simultaneously performed. There is an advantage of being.

P0, P1, P2 Medium 100 Data transfer device 10 Camera 20 Data capture unit 21 Number assigning units 30A to 30N Data transfer unit 1 to data transfer determination unit N
31A to 31N Data Transfer Determination Unit 1 to Data Transfer "Determination Unit N
32A to 32N DMA transfer unit 1 to DMA transfer unit N
40A to 40N Image processing unit 1 to image processing unit N
41A to 41N Image determination unit 1 to image determination unit N
42A to 42N result notification unit 1 to result notification unit N
50A to 50N Image processing unit 1 to image processing unit N
60 General determination units 130A to 130N Data transfer unit 1 to data transfer unit N
140A to 140N Image processing unit 1 to image processing unit N
150A to 150N Image processing unit 1 to image processing unit N

Claims (4)

In an image processing apparatus having a data capturing unit that captures image data acquired from a medium conveyed at a predetermined pitch, and a plurality of image processing units that process the image data captured by the data capturing unit.
The data fetching unit assigns a continuous data number to the image data, and transmits the image data to which the data number is assigned in parallel to the plurality of image processing units,
Each of the image processing units
Storage means for storing the image data assigned with the serial number received from the data fetching means;
Image processing means for performing predetermined processing on the image data;
Transfer permission monitoring means for monitoring whether the image processing means can process the next image data;
A transfer right indicating that image data transfer to the image processing means in the image processing unit is permitted and a transfer right number indicating the number of image data to be transferred to the image processing means are received from other image processing units. Transfer right acquisition means for storing;
When the transfer right and transfer right number are acquired by the transfer right acquisition unit, and as a result of monitoring by the transfer permission monitoring unit, the image data can be processed, the transfer is performed from the image data stored in the storage unit. The image data assigned with the serial number that matches the right number is transferred to the image processing means, and the transfer right number is incremented and transferred to the transfer right acquisition unit of the next image processing unit together with the transfer right, and the transfer Data transfer control means for transferring the transfer right and the transfer right number to a transfer right acquisition unit of the next image processing unit when image data processing is impossible as a result of monitoring by the permission monitoring means;
An image processing apparatus.   The image processing apparatus according to claim 1, wherein the transfer right is information transferred between transfer right acquisition means provided in each image processing unit, and is sequentially transferred according to a preset order. In an image processing apparatus having a data capturing unit that captures image data acquired from a medium conveyed at a predetermined pitch, and a plurality of image processing units that process the image data captured by the data capturing unit.
The data fetching unit assigns a continuous data number to the image data, and transmits the image data to which the data number is assigned in parallel to the plurality of image processing units,
Each of the image processing units
Data transfer means for transferring image data received from the data capture means;
Image processing means for processing the image transferred from the data transfer means;
Have
The data transfer means includes
Storage means for storing the received image data assigned with the serial number;
Transfer permission monitoring means for monitoring whether the image processing means can process the next image data;
A transfer right indicating that image data transfer to the image processing means in the image processing unit is permitted and a transfer right number indicating the number of image data to be transferred to the image processing means are received from other image processing units. Transfer right acquisition means for storing;
When the transfer right and transfer right number are acquired by the transfer right acquisition unit, and as a result of monitoring by the transfer permission monitoring unit, the image data can be processed, the transfer is performed from the image data stored in the storage unit. The image data to which the serial number corresponding to the right number is assigned is transferred to the image processing means, and the transfer right number is incremented and transferred together with the transfer right to the transfer right acquisition unit of the next image processing unit, and the transfer permission Data transfer control means for transferring the transfer right and the transfer right number to a transfer right acquisition unit of the next image processing unit when image data processing is impossible as a result of monitoring by the monitoring means;
An image processing apparatus. In an image processing apparatus having a data capturing unit that captures image data acquired from a medium conveyed at a predetermined pitch, and a plurality of image processing units that process the image data captured by the data capturing unit.
The data fetching unit assigns a continuous data number to the image data, and transmits the image data to which the data number is assigned in parallel to the plurality of image processing units,
Each of the image processing units
Data transfer means for transferring image data received from the data capture means;
Image processing means for processing the image transferred from the data transfer means,
The image processing means includes
Transfer permission monitoring means for monitoring whether the image processing means can process the next image data;
Transfer right acquisition indicating that transfer of image data to the image processing unit is permitted and transfer right number indicating the number of image data to be transferred to the image processing unit from another image processing unit Means,
When the transfer right and the transfer right number are acquired by the transfer right acquisition unit, and as a result of monitoring by the transfer permission monitoring unit, image data can be processed, the transfer right number is assigned to the data transfer unit. After transmitting and making a transfer request, after receiving the image data from the data transfer means, the transfer right number is incremented and transferred together with the transfer right to the transfer right acquisition unit of the next image processing unit, and by the transfer permission monitoring means A data transfer control means for transferring the transfer right and the transfer right number to a transfer right acquisition unit of the next image processing unit when image data processing is impossible as a result of monitoring;
The data transfer means includes
Storage means for storing the received image data assigned with the serial number;
A DMA for transferring, to the image processing unit, image data assigned with a serial number that matches the transfer right number from the image data stored in the storage unit when receiving a transfer right number and a transfer request from the image processing unit; An image processing apparatus.

Images