EP4662016A1

EP4662016A1 - Apparatus for object classification and sortation, and a method of retrofitting the apparatus to an existing production line

Info

Publication number: EP4662016A1
Application number: EP23704748.5A
Authority: EP
Inventors: Jin Han Jeon; Budhi KIE; Kevin ONG; Glenn WESTONSMITH; Sidharta Andalam; Chi Trung NGO
Original assignee: Robert Bosch GmbH
Current assignee: Robert Bosch GmbH
Priority date: 2023-02-09
Filing date: 2023-02-09
Publication date: 2025-12-17
Also published as: WO2024165153A1

Abstract

Aspects concern an apparatus (100) for classifying and sorting an object (102), the apparatus (100) comprising a conveyor platform module (110) configured to receive the object (102) thereon, the conveyor platform module (110) comprises an interface portion (112), the interface portion (112) configured to be removably positioned on or attached to an existing conveyor system (160); an artificial intelligence-based object classification module (120) comprising at least one image sensor module (122) configured to obtain at least one object image (124, 126) of the object (102) on the conveyor platform module (110) and classify the object (102) using the at least one object image (124, 126) as input to predict an object class (128) of the object (102); and a robotic sortation module (130) arranged in data connection with the artificial intelligence-based object classification module (120) to receive the object class (128) and/or a coordinates of the object (102) with respect to the an existing conveyor system (160), the robotic sortation module (130) configured to sort the object (102) based on the object class (128).

Description

APPARATUS FOR OBJECT CLASSIFICATION AND SORTATION, AND A METHOD OF RETROFITTING THE APPARATUS TO AN EXISTING

PRODUCTION LINE

TECHNICAL FIELD

[0001] This disclosure relates to an apparatus for object classification. The disclosure is particularly useful, but not limited to classifying waste objects for sorting. In some aspects, the apparatus is capable of being retrofitted to an object sorting system.

BACKGROUND

[0002] Global annual waste is set to exponentially increase. Waste management is one of the major challenges the world is facing. Most of the trash or waste may comprise useful materials that are recyclable.

[0003] In a material recovery facility (MRF), waste objects may be identified and classified using various object classification methods. Some of these methods may involve the use of conventional RGB cameras or other image-capturing devices involving the use of near-infrared (NIR) radiation-based or terahertz (THz) radiation-based imaging technology.

[0004] However, implementation of some of the aforementioned technology may involve extensive modification(s) of existing conveyor belt systems and materials deployed in waste object sorting systems. For example, where THz radiation imaging technology is deployed, modifications may need to be made to a production line, supporting frames, and/or adapt any conveyor system in the production lines of the MRF to incorporate THz imaging sensors or scanners.

[0005] There exists a need to minimize the aforementioned modifications and provide a more efficient and/or effective apparatus to better classify and/or sort waste objects.

SUMMARY

[0006] This present disclosure was conceptualized to provide an apparatus for object classification. The disclosure is particularly useful, but not limited to classifying waste objects for sorting. In some aspects, the apparatus is retrofittable to an existing conveyor system, the existing conveyor system may form part of a waste object sorting system, such as, but not limited, to a manual sorting system. In some aspects, the apparatus includes a retrofit flat belt conveyor, a modular sensor platform with Al-based object classification module, and a robotic sortation module.

[0007] According to the present disclosure, an apparatus as claimed in claim 1 is provided. A method for retrofitting the apparatus to an existing conveyor system is defined in claim 10.

[0008] The dependent claims define some examples associated with the apparatus and method, respectively.

BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The disclosure will be better understood with reference to the detailed description when considered in conjunction with the non-limiting examples and the accompanying drawings, in which:

- FIG. 1 shows a schematic perspective side-view setup of an apparatus for obtaining object images for object classification and sortation, the apparatus capable of being retrofitted to an existing conveyor belt system or production line system in a material recovery facility (MRF), according to some embodiments;

- FIGS. 2 A to 2C show schematic views of the retrofittable conveyor platform module integrated with an object classification module of the apparatus of FIG. 1, the integrated module being configured to be fitted onto an existing conveyor system in an MRF;

- FIG. 3 A shows a system diagram of a particular implementation of the Al-based object classification module according to some embodiments; FIG. 3B shows examples of predicted object classes based on obtained object images using the Al-based object classification module;

- FIGS. 4 A to 4C are schematic views of various embodiments of the robotic sortation module;

- FIGS. 5 A to 5E show additional embodiments of the retrofittable conveyor platform module; and

- FIG. 6 shows a flow chart of a method of retrofitting the apparatus to an existing conveyor belt system or production line system in a material recovery facility (MRF).

DETAILED DESCRIPTION

[0010] The following detailed description refers to the accompanying drawings that show, by way of illustration, specific details and embodiments in which the disclosure may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure. Other embodiments may be utilized and structural, and logical changes may be made without departing from the scope of the disclosure. The various embodiments are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments.

[0011] Embodiments described in the context of one of the systems or methods are analogously valid for the other systems or methods.

[0012] Features that are described in the context of an embodiment may correspondingly be applicable to the same or similar features in the other embodiments. Features that are described in the context of an embodiment may correspondingly be applicable to the other embodiments, even if not explicitly described in these other embodiments. Furthermore, additions and/or combinations and/or alternatives as described for a feature in the context of an embodiment may correspondingly be applicable to the same or similar feature in the other embodiments.

[0013] In the context of various embodiments, the articles “a”, “an” and “the” as used with regard to a feature or element include a reference to one or more of the features or elements.

[0014] As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.

[0015] As used herein, the term “data” may be understood to include information in any suitable analog or digital form, for example, provided as a file, a portion of a file, a set of files, an electronic signal or stream, a portion of a signal or stream, a set of signals or streams, and the like. The term data, however, is not limited to the aforementioned examples and may take various forms and represent any information as understood in the art.

[0016] As used herein, the term “THz image sensor” refers broadly to THz-based systems for identifying an object, which usually comprises a transmitter or source and a receiver/scanner. The term “THz radiation” refers to electromagnetic waves/radiation within the frequency range of 0.1 to 10 THz. THz radiation may transmit through non-polar and non- conductive materials, particularly plastic objects, and may be used to identify different types of plastic objects.

[0017] As used herein, the term “object” includes any object, particularly recyclable or reusable object that may be identified according to type, class or categories. For example, object may be identified based on whether it is plastic or non-plastic (e.g. paper). Plastic objects may in turn be identified according to whether they are High-density polyethylene (HDPE), Polyethylene terephthalate (PET), Polypropylene (PP), Polystyrene (PS), Low-density polyethylene (LDPE), Polyvinyl chloride (PVC) plastic objects, post-consumer plastics (e.g. PP, PS, PVC), engineering plastics (e g. ABS, PE, PP, PA, PC, PC/ABS and HIPS), reinforced engineering plastics (PA6-GF35, PA66-GF35), and blended plastics (PC/ABS, PP/PE, HIPS/PS, HIPS/ABS). Such objects may include bottles, jars, containers, plates, bowls etc. of various shapes, forms (distorted, flattened) and sizes. In some instances, the object may be contaminated with food, grease (e.g. salad dressing), cooking oil, yogurt, liquid, shampoo, detergent, soy sauce, etc.

[0018] As used herein, the term “module” refers to, or forms part of, or includes an Application Specific Integrated Circuit (ASIC); an electronic circuit; a combinational logic circuit; a field programmable gate array (FPGA); a processor (shared, dedicated, or group) that executes code; other suitable hardware components such as one or more sensors, one or more robotic arms that provide the described functionality; or a combination of some or all of the above, such as in a system-on-chip. The term module may include memory (shared, dedicated, or group) that stores code executed by the processor.

[0019] As used herein, the terms ‘first’ and ‘second’, unless otherwise stated, are used for purposes of clarity and do not imply order or precedence.

[0020] The present disclosure comprises an apparatus for object classification that can be easily implemented on or retrofitted to an existing conveyor system. The object sorting apparatus may be attached to an existing conveyor system of a material recovery facility (MRF) and may be configured as a plug and play system comprising three or four modules. The object sorting apparatus can be added to an existing MRFs’ infrastructure regardless of the size of MRFs and the waste stream.

[0021] Referring to FIG. 1 to FIG. 3B, an apparatus 100 for classifying one or more objects 102 is disclosed. The apparatus 100 comprises a retrofittable conveyor platform module 110 configured to receive the object 102 thereon, the conveyor platform module 110 comprises an interface portion 112, the interface portion 112 configured to be removably positioned on or attached to an existing conveyor system 160; an artificial intelligence-based (Al-based) object classification module 120 comprising at least one image sensor module 122 configured to obtain at least one object image 124, 126 (see FIG. 3B) of the object 102 on the conveyor platform module 110 and classify the object 102 using the at least one object image 124, 126 as input to predict an object class 128 of the object 102; and a robotic sortation module 130 arranged in data connection with the Al-based object classification module 120 to receive the object class 128, the robotic sortation module 130 configured to sort the object 102 based on the object class 128. In some embodiments, the coordinates of the object 102, as will be elaborated subsequently, based on the position on the existing conveyor system 160, may also be used as an input for sortation of the object 102.

[0022] The one or more objects 102 may be waste objects positioned on an existing conveyor system 160 of a material recovery facility (MRF) for recycling.

[0023] In some embodiments, the conveyor system 160 may include a feeding line 160a and a sorting line 160b. The feeding line 160a may be an inclined conveyor belt and the sorting line 160b may be a relatively long flat conveyor belt line, and one or more manual, such as human sorters may be positioned in the proximity of the sorting line 160b to retrieve objects for sorting.

[0024] In the embodiment shown in FIG. 1, the conveyor platform module 110 is positioned between the inclined feeding line 160a and the sorting line 160b in a manner so as to receive the one or more objects 102 from the inclined feeding line 160a. In some embodiments, the inclined feeding line 160a may be positioned lower relative to an upper sorting line 160b. The conveyor platform module 110 may be attached to a conveyor portion of the sorting line 160b and positioned on top/ above of the conveyor portion of the sorting line 160b as an overlapping member of the sorting line 160b. In some embodiments, the conveyor platform module 110 may be positioned just after the end or edge of the inclined feeding line 160a and/or at the beginning region of the sorting line 160b. In some embodiments, the conveyor platform module 110 may be positioned at a drop region between the sorting line 160b and the inclined feeding line 160a.

[0025] The conveyor platform module 110 and the Al-based object classification module 120 may be integrated so that when the one or more objects 102 are on the conveyor platform module 110, the image sensor module 122 is operable to obtain object images 124, 126 of each object 102.

[0026] The robotic sortation module 130 may be positioned downstream the conveyor platform module 110 and the Al-based object classification module 120 of a sorting line 160b. The robotic sortation module 130 may comprise at least one robotic arm 132 configured to retrieve objects 102 from the sorting line 160b or downstream of the sorting line 160b for sorting.

[0027] An optional object tracking module 140 may be provided to track the position of the one or more objects 120 on the existing conveyor system 160. The object tracking module 140 may include one or more image-capturing devices 142 configured to track the position of the object(s) 120 on the existing conveyor platform 160 between the conveyor platform module 110 and the robotic sortation module 130. In some embodiments, the object tracking module 140 may include one or more processors installed with computer vision and/or image processing software to facilitate the tracking function.

[0028] FIGS. 2A to 2C show embodiments of the conveyor platform module 110 integrated with the object classification module 120.

[0029] The interface portion 112 of the conveyor platform module 110 may be configured to be removably positioned on or attached to the existing conveyor system 160. In some embodiments, the interface portion 112 may include one or more fasteners such as clamps to attach the conveyor platform module 110 to one or more sides of the existing conveyor system 160. In some embodiments, the conveyor platform module 110 may comprise anti-slip stands formed of materials such as rubber, the anti-slip stands to be positioned on the existing conveyor system 160.

[0030] The conveyor platform module 110 comprises a conveyor belt 111, and a slot 114 formed on an under-side or underneath the conveyor belt 111 to receive a portion of the image sensor module 122.

[0031] The image sensor module 122 of the Al-based object classification module 120 may comprise a first image sensor 123 configured to obtain an RGB object image 124 of the object 102 on the conveyor platform module 110 and a second image sensor 125 configured to obtain a power intensity heatmap image 126 generated based on a THz electromagnetic radiation irradiated on the object 102 on the conveyor platform module 110. The first image sensor 123 may be a RGB camera or video recorder. The second image sensor 125 may comprise a THz source 125a and a scanner 125b. The THz source 125a may be configured to emit an electromagnetic radiation in a THz frequency range. The scanner 125b may be suitably receive in the slot 114 underneath the conveyor belt 111. The THz scanner 125b and the THz source 125a may be arranged in a manner such that THz radiation emitted from the THz source 125a passes the object 102 and the resultant radiation that passes the object 102 is incident on the scanner 125b. The captured radiation by the scanner 125b may then be processed and used to form the power intensity heatmap image 126.

[0032] FIGS. 2B and 2C show suitable positions where the linear scanner 125b may be positioned, within a slot 114 formed underneath the conveyor belt 111.

[0033] A frame 116 may comprise two extensions 116a, 116b extending vertically from the sides of the conveyor platform module 110, the two extensions 116a, and 116b joined by a horizontal portion 116c. The horizontal portion 116c may comprise respective mounts for mounting the first image sensor 123 and the THz source 125a. The frame 116 may also comprise a housing to contain the Al-based object classification module 120 therein. The frame 116 may be formed from or of metallic materials. In some embodiments, one or more visible light source(s) may be positioned in the vicinity of the first image sensor 123 to provide visible lighting to facilitate RGB image capturing.

[0034] FIG. 3A shows a processor 200 as an exemplary implementation of the Al-based object classification module 120.

[0035] The processor 200 comprises an input module 202, an artificial intelligence (Al) module 204, and an output module 206.

[0036] The input module 202 is configured to receive the obtained and/or generated images from the first image sensor 123 and the second image sensor 125. The image sensors 123, 125 may be equipped with data communication capabilities to transmit the obtained object images 124, 126 as data to the input module 202. The input module 202 may be arranged in data communication or connection with the image sensors 123, 125 via wired or wireless data communication protocol.

[0037] The Al module 204 is configured to receive the RGB image and THz image of the object 102 as inputs, and produce a predicted object class 128, the object class 128 forming part of the output dataset of the Al module 204. The Al module 204 may comprise Al algorithms such as deep learning convolutional neural networks. The Al module 204 may also include object or feature detection algorithms such as YOLOv4 algorithm, DeepSORT algorithm. Other known computer vision/ image processing techniques known to a skilled person may be combined/supplemented to form further embodiments to supplement and/or replace the ML/ Al algorithms.

[0038] In some embodiments, the Al module 204 may be trained to recognise contamination on the object images 124, 126.

[0039] The Al module 204 may utilize a sensor fusion method that extract salient features from the RGB image 124 and THz heatmap image 126 for object classification and to determine detailed material content, for example, a degree of contamination and abnormal objects, such as unexpected items, that do not belong to general waste, e.g., toxic industrial waste (e.g. chemical bottles, drug), biohazardous waste (e.g. syringe). An example of feature extraction may involve steps of defining regions of interest (ROIs), such as bounding boxes around the object images, and utilizing image processing and computer vision techniques including steps of segmentation and labelling.

[0040] The output module 206 may be configured to store the object images 124, 126 in various data formats such as png, tiff, jpeg, bmp, etc. The output module 206 may be equipped with data communication devices to send the image data to the robotic sortation module 130. In some embodiments, the output module 206 may be configured to send the object images 124, 126 together with the coordinate information of identified region(s) of interest (ROI) on the object images. Such coordinates information may be derived based on height and/or depth information from an RGB camera having depth scanning capabilities.

[0041] FIG. 3B show some examples of predicted object classes 128 based on the object images 124, 126 as inputs to the Al-based object classification module 120. As an object 102 passes an image-capturing region of the first image sensor 123, an RGB object image 124 is obtained. As the object 102 passes the image-capturing region of the second image sensor 125, the electromagnetic radiation emitted by source 125a is incident on the object 102 and passes through the object 102. A modified (e.g. reflected, refracted, deflected) electromagnetic radiation is obtained by the THz scanner 125b. The spectral data obtained by the THz scanner 125b may be obtained using the THz scanner 125b configured to have a relatively wide spectral range of 0.05 GHz to 0.7 THz. The spectral data is then used to render a THz object image 126. The RGB object image 124 and the THz object image 126 may be rendered at the aforementioned processor of the Al-based object classification module 120.

[0042] It is envisaged that the Al module 204 may be utilised to differentiate post-consumer plastics (PET and HDPE bottle), the packaging materials (LDPE clear/colour, Cardboard, Paper, Paper bag (with plastic layer), PP/PET straps and Jumbo bag (PP)) and other rigid engineering plastics (HDPE/PP) by combining features extracted from the obtained THz object image 214 and RGB object image 212. Different THz features (for example, shape, THz pattern intensity based on different THz transmittance, reflectance and absorbance according to material types) and RGB features (e.g., shape, colour) may be used for advanced recyclable plastics material classification.

[0043] FIGS. 4 A to 4C show an embodiment of the robotic sortation module 130 arranged in data connection with the artificial intelligence-based object classification module 120 to receive the output object class 128 and to sort the object 102 based on the object class 128. The robotic sortation module 130 may comprise an industrial robotic arm 132 and a mounting gantry structure 134. The gantry structure 134 may be in the form of a frame, the gantry frame 134 configured to mount the robotic arm 132, the robotic arm 132 positioned to pick up objects 102 from the existing conveyor system 160. As shown in FIG. 4 A, the gantry frame 134 may comprise two vertical supports 134a, 134b positioned such that a portion of the existing conveyor system 160 is positioned between the two supports 134a, 134b. The robotic arm 132 may be mounted at a horizontal beam 134c joining two ends of the vertical supports 134a, 134b.

[0044] In some embodiments, the robotic sortation module 130 may be equipped with a controller 136. The controller 136 may receive input data relating to the predicted object class 128 and corresponding object images 124, 126. In some embodiments, the controller may also be configured to receive position data of the object 102 as the object 102 moves along the existing conveyor system 160.

[0045] In some embodiments, the robotic arm 132 may be an industrial robot arm ABB IRB 1200 can be mounted horizontally on the gantry frame 134 as show in Fig. 4A. The gantry frame 134 can be installed on the existing conveyor system 160 in MRFs and plastic recycling processing facilities. The controller 136 can be mounted on the gantry frame 134. In some embodiments, the controller 136 can include encoding, conveyor belt speed tracking, and a gripper system for sending control signals to the robotic arm 132 to pick up the object 102 for sorting.

[0046] FIG. 4B shows an arrangement and a top perspective view of the conveyor belt system 160 and the robotic sortation module 130. FIG. 4C shows an arrangement and side perspective view of the conveyor belt system 160 and the robotic sortation module 130. The robotic arm 132 may be configured to pick and drop objects for sorting according to the type of objects, for example 4 types of objects into discharging bins 139. For example, discharging bin 1 for PET bottle, discharging bin 2 for HDPE bottle, discharging bin 3 for carton, discharging bin 4 for metallic can. It is contemplated that all discharging settings and capacities can be set in line with a user’s waste input steam and output requirement. In some embodiments, a plurality of robotic arms 132 arranged in series can be configured according to the existing processing & sorting lines and their waste input/output stream and volume in the MRFs.

[0047] In some embodiments, there is an object tracking module 140 positioned between the conveyor platform module 110 and the robotic sortation module 130. The object tracking module 140 may comprise at least one image-capturing device, which may be a RGB camera positioned to re-identify objects 102 and track the movement of objects 102 along the existing conveyor system 160. This is to account for situations where the position of some objects 102 may change after the object 102 is discharged from the conveyor platform module 110. The position information or data of the objects 102 can be re-identified using machine learning material identification and tracking algorithm (ROI detection). The respective coordinates of each of the objects 102 may be sent to the robotic controller 136 for the subsequent robotic sortation process.

[0048] FIG. 5 A shows another embodiment of the conveyor platform module 110 with a retrofit flat belt conveyor system integrated with the Al-based object classification module 120. The Al-based object classification module 120 may be configured for the optical image capturing of objects using the first image sensor 123, deep learning of waste object detection and classification in an Al platform, and detailed material content, for example, contamination and anomaly identification module using the THz image sensor 125, and a conveyor belt system. In some embodiments, the image sensor module 122 includes a lighting setup for obtaining clear and reliable images. In some embodiments, a two-ply or three-ply Polyvinyl chloride (PVC) dark green belt may be used for the conveyor belt 111 material. In some embodiments, the conveyor speed may be configured to be in the range of 0.3 to 1.5 meters per second and may be controlled by a frequency inverter 113. In some embodiments, the conveyor platform module 110 comprises at least one object guide, the at least one object guide 502 shaped and dimensioned to guide the object 102 to an image capturing region of the conveyor platform module 110.

[0049] In some embodiments, the object guide 502 may be a metallic side guide along the perimeter of the conveyor belt 111, and a part of the metallic side guide may extend towards a center region of the conveyor belt 111 corresponding to the image capturing regions. Such an arrangement will define a funnel -like profile for directing the object(s) 102 from the feeding line 160a in line with the image capturing region of THz image sensor 125. In some embodiments, the metallic side guide may be formed from or of aluminum profile. The aluminum profile may be a 40x40 or 20x20 profile.

[0050] FIGS. 5B and 5C show another embodiment of the conveyor platform module 110 with a retrofit flat belt conveyor system integrated with the Al-based object classification module 120. The embodiment of FIG. 5B comprises a slide plate 504 positioned at an entry side of the retrofit flat belt conveyor 111 for smooth feeding of object 102 which may be dropped from the inclined feeding belt 160a or an upper feeding belt line. The angle and slope length may be adjusted or adapted to minimize any mis-feeding of objects 102. For example, any rolling items on the retrofit flat conveyor belt 111, poor distribution with overlapping of objects 102 may be minimized. To facilitate smooth and reliable feeding of objects 102 to the image capturing region(s), the angle of slope may be between 10 degrees (°) and 40° with respect to the horizontal and the slope length may be between 150 millimeters (mm) and 230 mm.

[0051] FIG. 5C shows various embodiments of a retrofit flat belt conveyor with slide plates 504 inclined at angles of between 10° and 40°, and with varying slope length, to facilitate smooth feeding of waste stream input

[0052] In some embodiments, one or more air-jetting hole arrays 506 may be added to the slide plate 504 to vibrate the slide plate 504 so as to facilitate distribution of multiple objects 102 on the conveyor belt 111.

[0053] In another embodiment as shown in FIG. 5D, the metallic sliding plate can be adapted for proper angle and slope length based on the aforementioned description, and the additional side panel(s) 508 may be added to facilitate smooth feeding of objects 102 onto the retrofit flat belt conveyor 111. The side panels 508 may be shaped and dimensioned to direct objects 102 around the edges of the slide plate 506 to the center portion of the conveyor belt 111. One side of the side panel 508 may be affixed to the slide plate 506 with fasteners such as screws, and the other end may be trimmed at a connection to the side belt. The thickness of this side panel may be 1.5mm, and its detailed design is depicted in FIG. 5E.

[0054] In some embodiments (not shown), roller brushes can be added to one or more sides underneath the flat belt conveyor 111 for cleaning any liquid and dust for clean and safe operation.

[0055] It is contemplated that the aforementioned description provides a cost-effective, efficient and flexible retrofit automated sorting and recycling technology for material recovery facilities and recycling processing facilities to improve their sorting quality and productivity without modifying their existing processing and sorting lines. As it does not require significant modifications of the existing processing and sorting lines and improves the sorting quality and productivity by 2 times to 3 times compared to conventional manual sorting. The Al based object classification module 120 comprising image sensors to capture object images for object detection and tracking, and Terahertz radiation for material classification using deep learning method. Furthermore, it can detect contamination and add value to improve sorting grade.

[0056] FIG. 6 shows a flow chart of a method 300 of retrofitting an existing conveyor system for classifying an object 102, the method 200 comprising the steps of [0057] Step 302: providing a conveyor platform module 110, the conveyor platform module 110 configured to receive the object 102 thereon, the conveyor platform module 110 comprises an interface portion 112, the interface portion 112 configured to be removably positioned on or attached to an existing conveyor system 160;

[0058] Step 304: providing an artificial intelligence-based object classification module 120 comprising at least one image sensor module 122, the at least one image sensor module 122 configured to obtain at least one object image 124, 126 of the object 102 on the conveyor platform module 110 and classify the object 102 using the at least one object image 124 as input to predict a class of the object 102 and provide an object class 128 of the object 102; and [0059] Step 306: providing a robotic sortation module 130 arranged in data connection with the artificial intelligence-based object classification module 120 to receive the object class 128, the robotic sortation module 130 configured to sort the object 102 based on the object class 128.

[0060] According to another aspect of the disclosure there is a computer program comprising instructions which, when executed by a processor, cause the processor to carry out a method of object classification within the Al-based object classification module 120.

[0061] While the disclosure has been particularly shown and described with reference to specific embodiments, it should be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims. The scope of the disclosure is thus indicated by the appended claims and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced.

Claims

1. An apparatus (100) for classifying and sorting an object (102), the apparatus (100) comprising a conveyor platform module (110) capable of being configured to receive the object (102) thereon, the conveyor platform module (110) comprises an interface portion (112), the interface portion (112) capable of being configured to be removably positioned on or attached to an existing conveyor system (160); an artificial intelligence-based object classification module (120) comprising at least one image sensor module (122) capable of being configured to obtain at least one object image (124, 126) of the object (102) on the conveyor platform module (110) and classify the object (102) using the at least one object image (124, 126) as input to predict an object class (128) of the object (102); and a robotic sortation module (130) arranged in data connection with the artificial intelligence-based object classification module (120) to receive the object class (128), the robotic sortation module (130) capable of being configured to sort the object (102) based on the predicted object class (128).

2. The apparatus (100) of claim 1, wherein the at least one image sensor module (122) comprises at least one of: a first image sensor (123) capable of being configured to obtain an RGB image (124) of the object (102) on the conveyor platform module (110) and a second image sensor (125) capable of being configured to obtain a power intensity heatmap image (126) generated based on THz electromagnetic radiation incident of the object (102) on the conveyor platform module (110).

3. The apparatus (100) of claim 2, wherein the second image sensor (125) comprises a THz source (125a) and a scanner (125b), and the conveyor platform module (110) comprises a slot (114) formed underneath a conveyor belt (111) of the conveyor platform module (110) to receive the scanner (125b).

4. The apparatus (100) of claim 2 or 3, wherein the conveyor platform module (110) and the artificial intelligence-based object classification module (120) are integrated to form a single module.

5. The apparatus (100) of claim 4, further comprises a frame (116) extending from the conveyor platform module (110), the frame (116) capable of being configured to house the artificial intelligence-based object classification module (120).

6. The apparatus (100) of any one of claims 2 to 5, wherein the conveyor platform module (110) comprises at least one object guide (502), the at least one object guide (502) shaped and dimensioned to guide the object (102) to an image capturing region of the at least one image sensor module (122) of the conveyor platform module (110).

7. The apparatus (100) of any one of the preceding claims, wherein the robotic sorter (130) comprises a gantry frame (134), the gantry frame (134) capable of being configured to mount a robotic arm (132), the robotic arm (132) capable of being configured to pick up objects (102) from the existing conveyor system (160).

8. The apparatus (100) of any one of the preceding claims, further comprises an object tracking module (140) positioned between the conveyor platform module (110) and the robotic sortation module (130), the object tracking module (140) capable of being configured to track the object (102) between the conveyor platform module (110) and the robotic sortation module (130) on the existing conveyor system (160).

9. The apparatus (100) of claim 8, wherein the object tracking module (140) comprises at least one image-capturing device (142) capable of being configured to track the position of the object(s) 120 between the conveyor platform module (110) and the robotic sortation module (130).

10. A method (300) of retrofitting an existing conveyor system for classifying and sorting an object (102), the method (200) comprising the steps of: providing (302) a conveyor platform module (110), the conveyor platform module (110) capable of being configured to receive the object (102) thereon, the conveyor platform module (110) comprises an interface portion (112), the interface portion (112) capable of being configured to be removably positioned on or attached to an existing conveyor system (160); providing (304) an artificial intelligence-based object classification module (120) comprising at least one image sensor module (122), the at least one image sensor module (122) capable of being configured to obtain at least one object image (124) of the object (102) on the conveyor platform module (110) and classify the object (102) using the at least one object image (124) as input to predict a class of the object (102) and provide an object class (128) of the object (102); and providing (306) a robotic sortation module (130) arranged in data connection with the artificial intelligence-based object classification module (120) to receive the object class (128), the robotic sortation module (130) capable of being configured to sort the object (102) based on the predicted object class (128).

11. The method (300) of claim 11, wherein the conveyor platform module (110) and the artificial intelligence-based object classification module (120) are integrated to form a single module.