CN113135368A

CN113135368A - Intelligent garbage front-end classification system and method

Info

Publication number: CN113135368A
Application number: CN202110475037.XA
Authority: CN
Inventors: 王庆楠; 何贤杰; 曾自强; 金佑松; 王博
Original assignee: Huaihua University
Current assignee: Huaihua University
Priority date: 2021-04-29
Filing date: 2021-04-29
Publication date: 2021-07-20
Anticipated expiration: 2041-04-29
Also published as: CN113135368B

Abstract

The invention provides an intelligent garbage front-end classification system and a method, wherein the intelligent garbage front-end classification system comprises: the system comprises a garbage image recognition system, an automatic garbage classification and delivery system and a garbage information processing system. In the application, based on the garbage image recognition system, the automatic garbage classification and delivery system and the garbage information processing system, the intelligent garbage front-end classification system can independently run in a distributed mode, automatically recognize and automatically classify to deliver garbage, can collect and feed back garbage classification information, and can update the extended function in a networking mode.

Description

Intelligent garbage front-end classification system and method

Technical Field

The invention relates to the field of garbage classification treatment, in particular to an intelligent garbage front-end classification system and method.

Background

Due to the requirements of environmental protection and resource recovery, the nation puts forward strict garbage classification management requirements, and the current garbage classification standard is to classify garbage into four categories: can recover garbage, kitchen garbage, harmful garbage and other garbage. The error rate is high due to the limitation of the knowledge structure of the artificial garbage classification; the mechanical or electronic sensing garbage classification mainly utilizes material physical properties or basic shapes and colors to classify garbage, is only suitable for specific industrial fields such as metal garbage, building garbage and the like, and has poor expandability. The garbage front-end classification mainly treats daily domestic garbage, has no fixed shape and physical property, is various in types and complex in background, and is difficult to effectively classify by adopting a traditional method. Meanwhile, the existing garbage front-end classification system is mainly controlled by a remote server or a workstation, and the application occasions of garbage front-end classification are dispersed and strong in real-time performance, so that the existing garbage front-end classification system cannot independently, quickly and accurately respond to garbage classification work.

Disclosure of Invention

The invention aims to: in order to solve the technical problems existing in the prior art, the intelligent garbage front-end classification system and method which can operate independently and in a distributed mode, automatically identify, automatically classify and release and advertise and guide are realized.

The technical purpose is realized by the following technical method: an intelligent garbage front-end classification system, comprising: the system comprises a garbage image recognition system, an automatic garbage classification and delivery system and a garbage information processing system.

The garbage image recognition system is an embedded image recognition system, is deployed on a garbage front-end classification device, and is used for image acquisition and recognition of garbage. And acquiring images of the garbage, namely performing visual acquisition through a camera to acquire images of the garbage. And the image recognition of the garbage is to compare the data loaded with the pre-training model with the collected image so as to recognize the specific name or the type of the garbage.

The automatic garbage sorting and throwing system comprises an image recognition system, a garbage putting device, a throwing mechanism and a sorting garbage bin, wherein the image recognition system recognizes the specific name or the type of garbage, and the throwing mechanism automatically throws the garbage into the sorting garbage bin corresponding to the garbage.

The garbage information processing system is an information data acquisition and feedback system. The garbage information processing system detects the garbage classification working condition and feeds back information in real time, collects and feeds back the type and the quantity corresponding to the thrown garbage, detects the full load of the classification garbage bin and feeds back the information, and plays the garbage classification promo piece in a circulating mode.

An intelligent garbage front-end classification method based on the intelligent garbage front-end classification system comprises the following steps: the method comprises the following steps of identifying the garbage image, automatically classifying and putting the garbage and processing the garbage information.

Starting the intelligent garbage front-end classification system, starting system operation timing, carrying out visual acquisition by the camera, acquiring a frame of image by the video acquired by the visual acquisition for preprocessing and decoding, carrying out initial calibration on the image, and loading the pre-training model.

In the standby process, a display screen of the garbage information processing system circularly plays garbage classification promos, and propagates garbage classification knowledge and a using method of the intelligent garbage front-end classification system.

In the standby process, the camera carries out visual acquisition and object detection. And acquiring a frame of image for decoding, comparing the frame of image with the initial calibration, and judging whether garbage is put in.

When garbage is put into the object placing device, the garbage image recognition system acquires a frame of image for preprocessing and decoding, compares the frame of image with the initial calibration image, and judges that the object placing device is placed with garbage. And further extracting high-order abstract features and data of the pre-training model for detection and identification, and acquiring probability values of all label values, wherein if the probability value is the maximum or exceeds a threshold value, the label value corresponding to the probability value is assigned to the garbage, and the garbage marks specific garbage name information corresponding to the garbage. And classifying according to the specific garbage name information to obtain the category of the garbage. The garbage can be classified into four types, and garbage, kitchen garbage, harmful garbage and other garbage can be recovered.

According to the type of the garbage, the throwing mechanism automatically throws the garbage into a classification garbage can corresponding to the garbage type, and the classification garbage can comprises a harmful garbage can, a recyclable garbage can, a kitchen garbage can and other garbage cans.

And in the working process of the throwing mechanism, the garbage information processing system counts the garbage throwing and updates the garbage quantity information of the corresponding garbage can.

In the working process of the throwing mechanism, the garbage information processing system carries out full load detection on the garbage can to obtain full load information of the garbage can.

And the full load detection is based on the upper limit of the capacity of the dustbin, the measurement of the upper limit of the capacity of the dustbin is based on the height position of the rubbish of the dustbin, the height position of the rubbish is measured, and the full load information of the dustbin is fed back.

The garbage classification propaganda film is played in a stop-loop mode through the display screen, the video acquired by the camera vision is displayed in real time, the process of garbage automatic identification and automatic classification is displayed in real time, the specific garbage name information is displayed in real time, the classification information of the garbage is displayed in real time, the counting number is displayed in real time, the garbage quantity information is displayed in real time, and the full load information of the garbage can is displayed in real time.

The garbage can is fully loaded, the garbage information processing system sends information to a remote server through a network, and the classified garbage can is cleaned.

The intelligent garbage front-end classification system is connected with a remote server end through a network to update and upgrade so as to realize the updating of garbage identification types and the expansion of garbage identification quantity.

Compared with the prior art, the invention has the following beneficial effects: the intelligent garbage front-end classification system is deployed in a garbage front-end classification processing device, can independently run without a remote server or a workstation, and is strong in instantaneity, high in classification precision and high in stability. The garbage classification is carried out in an image recognition mode, is not limited by the variety, material and form of garbage, and is suitable for the diversity and complexity of daily household garbage. And automatically classifying the garbage through a garbage image recognition system, assigning specific name information of the garbage and assigning garbage category information. The pre-training model can be downloaded and updated through a network and deployed to a garbage front-end classification processing device, and the method is beneficial to improving the expansibility and the precision of garbage recognition. The automatic garbage sorting and throwing system automatically throws garbage into the corresponding sorting garbage bin. The garbage information processing system can carry out garbage input counting, can carry out full-load detection of the garbage can, is full-load and can send information to a remote server end through a network, and is beneficial to the cleaning efficiency and the cost management of the garbage can. The garbage information processing system plays the garbage classification promo when no garbage is thrown in, and feeds back the specific name information of the garbage and the classification information of the garbage in real time when the garbage is thrown in, so that the garbage information processing system is beneficial to guiding and enhancing the garbage classification consciousness of a user.

Drawings

To further illustrate the invention, the following brief description of the embodiments or drawings required in the description of the prior art is not to be construed as limiting the invention.

Fig. 1 is a schematic diagram of a framework of the intelligent garbage front-end classification system of the present invention.

Fig. 2 is a schematic diagram of a framework of the spam image recognition system of the present invention.

Fig. 3 is a schematic diagram of a framework of the automatic garbage sorting and throwing system of the present invention.

FIG. 4 is a block diagram of a spam processing system in accordance with the present invention.

Fig. 5 is a schematic view of the garbage image recognition process of the present invention.

Fig. 6 is a schematic diagram of the automatic garbage sorting and throwing process of the present invention.

FIG. 7 is a flow chart illustrating garbage information processing according to the present invention.

Detailed Description

The following specific examples are given by way of illustration only and not by way of limitation, and it will be apparent to those skilled in the art from this disclosure that various changes and modifications can be made without inventive faculty to the invention without departing from the spirit and scope of the invention which is defined by the claims appended hereto.

The present invention will be described in detail below by way of examples with reference to the accompanying drawings.

An intelligent garbage front-end classification system, comprising: the system comprises a garbage image recognition system 1, an automatic garbage classification and delivery system 2 and a garbage information processing system 3.

The garbage image recognition system 1 comprises an image acquisition module 11, an image feature processing module 12 and an image recognition module 13.

The image recognition module 13 includes an image feature recognition comparison unit 131 and a pre-training model loading unit 132.

The automatic garbage sorting and throwing system 2 comprises a throwing mechanism 21, a storage device 22 and a sorting garbage can 23.

The sorting garbage box 23 includes a recyclable garbage box 231, a kitchen garbage box 232, a harmful garbage box 233 and other garbage boxes 234.

The junk information processing system 3 includes a junk counting module 31, a full load detection module 32, a junk information recording module 33, an information display module 34, an information voice module 35, and a communication transmission module 36.

The image acquisition module 11 includes a camera 111, a light supplement device 112, and a light shielding plate or a light shielding cover 113, the camera 111 is used for capturing real-time images, and the light supplement device 112 and the light shielding plate or the light shielding cover 113 are used for reducing the influence of external strong ambient light and eliminating shadows.

The throwing mechanism 21 comprises a bottom layer motor or a steering engine 211 and an upper layer motor or a steering engine 212, and the angle of the object placing device 22 is changed or/and the phase of the classification garbage can 23 is changed through the combined motion of the bottom layer motor or the steering engine 211 and the upper layer motor or the steering engine 212, so that garbage is thrown in a classification mode.

If the upper layer motor or the steering engine 212 executes a predetermined action, the feeding mechanism 21 triggers a counting signal, the garbage counting module 31 records the garbage feeding times, and sends information to the information display module 34.

The full load detection module 32 measures the full load condition of the garbage through a sensor 321, and after the measured value reaches a preset threshold value, the full load detection module 32 records and sends a full load signal to the information display module 34, the information voice module 35 and the communication transmission module 36.

The sensor 321 is a laser ranging sensor, an infrared ranging sensor, or an ultrasonic ranging sensor, and performs distance measurement by emitting and feeding back laser light, infrared light, or sound waves. The sensor 321 is preferably a laser ranging sensor.

The sensor 321 detects the full load of the classification garbage can 24 by measuring the height of the volume of the classification garbage can 24 through the sensor 321, and a certain height of the volume is used as a threshold value for the full load detection, and the threshold value is 75% to 85% of the height of the classification garbage can 24.

The sensor 321 is arranged along the inner wall of the classification garbage can 23 or perpendicular to the bottom of the classification garbage can 23. The sensor 321 is arranged along the inner wall of the classification garbage can 23, the sensor 321 is arranged at a height threshold value for full-load detection, and the sensor 321 senses the threshold value at 50% ± 10% of the distance between the inner walls of the classification garbage can 23. The sensor 321 is arranged perpendicular to the bottom of the classification garbage can 23, and the sensor 321 senses that the threshold is set at the height threshold of the classification garbage can 23.

The information display module 34 includes a display screen 341 and a working status indicator light 342, and the display screen 341 functions to display the working status of the system, play video cyclically, display the delivery process in real time, display the name information of specific garbage, display the garbage category information, display the garbage delivery count, display the garbage amount in the garbage classification box, and display the full load information. An operating status indicator light 342 is shown to indicate the operating status of the system unit.

The communication transmission module 36 comprises a serial communication module 361 and a network communication module 362, the serial port communication module 361 realizes the communication among the image acquisition module 11, the image feature processing module 12 and the image recognition module 13, the serial port communication module 361 realizes communication between the image recognition module 13 and the drop mechanism 21, the serial port communication module 361 realizes the communication between the throwing mechanism 21 and the garbage counting module 31, the serial port communication module 361 realizes the communication between the garbage counting module 31 and the information display module 34 and the information voice module 35, the serial communication module 361 enables communication between the sensor 321 and the full load detection module 32, the serial communication module 361 implements the full load detection module 32, the information display module 34, the information voice module 35, and the network communication module 362. The network communication module 362 implements network networking, updates the pre-training model loading unit 132 of the image recognition module 13, and sends the full-load alarm information of the full-load detection module 32.

Based on the system, the embodiment of the garbage classification method is provided, and the intelligent garbage front-end classification method comprises the following steps: after the garbage is placed in the storage device, the garbage image recognition system recognizes that garbage is placed and garbage categories exist, and the automatic garbage classification and delivery system delivers the garbage to the classification garbage can; the garbage information processing system detects the working condition and feeds back information in real time, and the functions of the system are updated through networking.

The method for identifying garbage input and garbage category by the system is as follows.

In step S11, the image acquisition module 11 captures an ith frame image as a reference calibration image through the camera 111. The image acquisition module 11 transmits the reference calibration image to the image feature processing module 12 to extract a key feature value, and further transmits the key feature value to the image recognition module 13 as a reference standard value.

Step S12, the image acquisition module 11 continuously captures images through the camera 111, acquires one frame of image to be identified every n frames of images compared with the i-th frame of reference calibration image, transmits the acquired image to the image feature processing module 12 to extract a key feature value, further transmits the extracted key feature value to the image identification module 13, compares the extracted key feature value with a reference standard value, and determines that garbage is put in if the difference exceeds a set threshold.

In step S13, after the placement device 22 puts garbage, the image recognition module 13 determines that garbage is put in, and sends a signal to the garbage information processing system 3 and the image recognition module 13. The image recognition module 13 abstracts the bottom-layer features to the high-layer features of the image features to be recognized, and the image feature recognition comparison unit 131 compares the image features with the data loaded by the pre-training model loading unit 132 to obtain the probability value of the image to be recognized belonging to a specific category.

In step S14, the image recognition module 13 takes the highest probability value of the image to be recognized or a value exceeding a certain threshold as the category attribute of the thrown garbage. The image recognition module 13 encodes classification information according to the garbage category attribute, and sends the classification information to the delivery mechanism 21 through the serial communication module 361.

In step S15, after the drop mechanism 21 completes the execution, the drop mechanism 21 feeds back a reset signal to the garbage image recognition system 1 through the serial communication module 361. The image acquisition module 11 is cleared, and the image feature processing module 12 is cleared. The image acquisition module 11 captures the ith frame image as a reference calibration image, and the subsequent steps are the same as those of S11-S14.

The method for automatically classifying the delivery of the system is specifically as follows.

In step S21, the delivering mechanism 21 receives the code classification information of the image recognition module 13, and drives the bottom layer motor or steering engine 211 and the upper layer motor or steering engine 212 to move jointly.

Step S22, the bottom layer motor or steering engine 211 and the upper layer motor or steering engine 212 move jointly to change the angle of the object placing device 22 or/and change the phase of the classification garbage can 23, so that the classification garbage can be thrown in.

Step S23, after the classified garbage throwing is completed, the bottom layer motor or steering engine 211 and the upper layer motor or steering engine 212 move together to restore the initial state of the storage device 22 or/and the classified garbage can 23. The feeding mechanism 21 feeds back a reset signal to the garbage image recognition system 1.

The method for detecting the working condition and feeding back the information in real time by the system is concretely as follows.

Step S31, the information display module 34 and the information voice module 35 of the spam processing system 3 cyclically play the spam classification method and display the recorded data of the spam recording module 33.

Step S32, the garbage image recognition system 1 determines that garbage is thrown in, and the information display module 34 displays the real-time working image of the automatic garbage classification throwing system 2 collected by the garbage image recognition system 1.

In step S33, the counting module 31 is triggered by the operation of the feeding mechanism 21, the counting module 31 records the number of garbage feeding times, the counting module 31 sends information to the garbage information recording module 33 to update the recorded data, and the counting module 31 sends feeding count information to the information display module 34.

In step S34, the information display module 34 reflects the system operating status and information in real time. The display screen 341 displays the working process of the garbage throwing mechanism 21 and the system working state and information stored in the garbage information recording module 33 in real time. The working state indicator light 342 displays the system working state stored in the garbage information recording module 33. The information voice module 35 broadcasts the kind of the garbage.

In step S35, after the classified garbage is thrown, the throwing mechanism 21 feeds back a signal to the garbage information processing system 3, and the garbage information processing system 3 returns to step S31.

In step S36, the release mechanism 21 is operated to trigger the full load detection module 32. The sensor 321 measures the sensing point at intervals of a certain time period, and detects whether a measurement threshold is reached.

In step S37, when the detected value exceeds the threshold value, the full-load detection module 32 sends full-load information to the spam recording module 33, and the spam recording module 33 updates the recorded data.

In step S37, if the detected value exceeds the measurement threshold, the communication transmission module 36 sends the full information of the spam recording module 33 to the server via the network. And cleaning the classification garbage box 23 according to the codes and the corresponding physical addresses of the intelligent garbage front-end classification system, and recovering the initial state of the full-load information of the garbage information recording module 33.

The method for updating the system function by the system networking is concretely as follows.

During the non-working time of the intelligent garbage front-end classification system, the garbage image identification system 1 performs information and data interaction with a remote server end through the communication transmission module 36 through a network. The garbage image recognition system 1 can replace a new network model trained by the server, and update of garbage recognition types and expansion of garbage recognition quantity are realized.

The above examples are only used to illustrate the technical solutions of the present invention, and do not limit the scope of the present invention.

Claims

1. The utility model provides an intelligence rubbish front end classification system which characterized in that includes: the system comprises a garbage image recognition system, an automatic garbage classification and delivery system and a garbage information processing system;

the garbage image recognition system comprises an image acquisition module, an image feature processing module and an image recognition module; the image acquisition module acquires an initial calibration image, a garbage image and a system working process image; the image feature processing module extracts key feature values of the image; the image recognition module performs high-level abstraction and data comparison on image characteristics and judges an image to be recognized;

the automatic garbage sorting and throwing system comprises a throwing mechanism, a storage device and a sorting garbage can; the throwing mechanism automatically sorts and throws garbage; the storage device prestores garbage; the classification garbage can stores garbage in a classification mode;

the garbage information processing system comprises a garbage counting module, a full load detection module, a garbage information recording module, an information display module, an information voice module and a communication transmission module; the garbage counting module is used for measuring the garbage throwing quantity; the full-load detection module measures the storage allowance of the classified garbage can; the information recording module stores system parameter information; the information display module displays system parameter information; the information voice module broadcasts system parameter information in a voice mode; the communication transmission module transmits information data and pre-training model data.

2. The spam image recognition system of claim 1, further comprising: the device comprises an image characteristic identification comparison unit, a pre-training model loading unit, a camera, a light supplementing device, a light shielding plate or a light shielding cover;

the image characteristic identification comparison unit compares and analyzes the image characteristic value;

the pre-training model loading unit stores and loads a pre-training model and data of the server;

the camera is used for shooting real-time images, and the light supplementing device and the light shielding plate or the light shielding cover are used for reducing the influence of external strong ambient light and eliminating shadows.

3. The automatic sorting and dumping system for refuse according to claim 1, further comprising: a bottom layer motor or a steering engine and an upper layer motor or a steering engine; the bottom layer motor or the steering engine and the upper layer motor or the steering engine are used for changing the angle of the object placing device or/and changing the phase of the classification garbage can.

4. A spam handling system according to claim 1 further comprising a sensor, a serial communication module and a network communication module;

the sensor measures the height of the volume of the classified dustbin, a certain height of the volume is used as a threshold value for full load detection, and a full load signal is sent out after the measured value reaches a preset threshold value;

the serial port communication module is used for transmitting information data of each module in the system;

the network communication module is used for networking a network, updating the pre-training model loading unit of the image recognition module and sending full-load alarm information of the full-load detection module.

5. The sensor of claim 4, wherein the sensor is disposed along an inner wall of the classification bin or perpendicular to a bottom of the classification bin, and the height threshold is 75% to 85% of the height of the classification bin;

if the sensor is arranged along the inner wall of the classification garbage can, the sensor is arranged at the height threshold, and the sensing distance of the sensor is 50% +/-10% of the distance of the inner wall of the classification garbage can;

if the sensor is arranged perpendicular to the bottom of the classification garbage can, the sensing distance of the sensor is the height threshold value of full load detection.

6. An intelligent garbage front-end classification method is characterized in that based on an intelligent garbage front-end classification system, the method comprises the following steps: the method comprises the following steps of identifying a garbage image, automatically classifying and putting garbage, and processing garbage information, wherein the method comprises the following steps:

after the garbage is put in, the system identifies the garbage putting and the garbage category and automatically classifies and puts the garbage into a classification garbage can;

the system detects the working condition and feeds back information in real time, serial port communication in the system transmits data information, the working process and system information of garbage throwing are displayed in real time, and the system information is broadcasted in a voice mode;

in the non-working time, the system performs information and data interaction with the server through the network, updates and loads the network model and data trained by the server, and updates or expands the type of garbage recognition.

7. The intelligent garbage front-end classification method according to claim 6, further comprising:

the image acquisition module captures an ith frame image as a reference calibration image, and the image feature processing module extracts a key feature value as a reference standard value;

the image acquisition module continuously captures images, one frame of image to be identified is acquired at intervals of n frames of images, the image feature processing module extracts key feature values, and the image identification module compares the key feature values with the reference standard value in a difference mode;

if the set threshold value is exceeded, the system recognizes that garbage is put in.

8. The intelligent garbage front-end classification method according to claim 6, further comprising:

the image recognition module abstracts the bottom-layer features to the high-layer features of the image features to be recognized, and the image feature recognition comparison unit compares the image features with the data of the pre-training model loading unit to obtain the probability value of the image to be recognized belonging to specific garbage or garbage categories; and the image identification module takes the highest probability value or the probability value exceeding a certain threshold value as the category attribute of the thrown rubbish.

9. The intelligent garbage front-end classification method according to claim 6, further comprising:

the garbage image recognition system codes the garbage category attribute, the garbage category attribute is sent to the throwing mechanism through the serial port communication module, the throwing mechanism drives a motor or a steering engine to move in a combined mode, the angle of the object placing device or/and the phase of the classified garbage can is changed, and garbage is thrown into the classified garbage can.

10. The intelligent garbage front-end classification method according to claim 6, further comprising:

the garbage throwing mechanism operates to trigger garbage throwing counting, the display screen displays the working process of throwing garbage by the throwing mechanism in real time, the display screen displays the working state and information of the system, and the information voice module broadcasts system information;

the throwing mechanism operates to trigger full load detection, and the sensor measures induction points at intervals of a certain time period T and detects whether the induction points reach a measurement threshold value;

if the detection value exceeds the measurement threshold value, the full-load detection module sends full-load information to the garbage information recording module through the serial port communication module, and the garbage information recording module updates recorded data;

if the detection value exceeds the measurement threshold value, the full-load detection module sends full-load information to a server end through the network communication module, the classification garbage can is cleaned according to the codes and the corresponding physical addresses of the intelligent garbage front-end classification system, and the full-load information of the garbage information recording module is restored to the initial state.