CN111476085A - A system and method for classifying and delivering garbage based on image recognition and reward points - Google Patents

Abstract

The present application discloses a system and method for classifying and placing garbage based on image recognition and reward points. For domestic garbage, the system and the system for classifying and placing garbage include classified and placed garbage bins, intelligent composite poles, garbage classification and placing management and control systems and Garbage throwing points management APP; classified throwing bins are used for sorting and storing garbage; smart cameras and prompting devices are installed on the intelligent composite pole; image information; the prompting device is used for prompting garbage classification and delivery information; the garbage classification and delivery management and control system is used for garbage classification and delivery management and control; the garbage delivery point management APP is used for the display and management of garbage delivery points. The application fully reuses the intelligent composite poles of urban municipal lighting, adopts image recognition and reward points, reduces the cost of the guidance device for garbage classification and placement, and improves the user experience and enthusiasm for classification and placement.

Description

A system and method for classifying and delivering garbage based on image recognition and reward points

technical field

The invention belongs to the technical field of garbage classification and delivery, and relates to a system and method for classifying and delivering garbage based on image recognition and reward points, in particular to a system and method for classifying and delivering domestic waste based on image recognition and reward points.

Background technique

With the acceleration of global urbanization and the improvement of material living standards, the population density in urban areas continues to increase, and the pressure on domestic waste disposal continues to increase. Effective recycling of garbage is the only way to reduce the final disposal volume of domestic garbage and realize the recycling of some valuable substances. It is also the only way to reduce resource consumption, beautify the living environment, and achieve sustainable social development and rational utilization of resources. Among them, the accurate and classified distribution of garbage is the first step. The Ministry of Housing and Urban-Rural Development of my country proposed at the 2019 National Urban Domestic Waste Classification Work Site Conference held in Shanghai on February 21 that from 2019, cities at the prefecture level and above will fully start the domestic waste classification work. By the end of 2020, 46 Key cities should basically build a garbage classification and treatment system, and before the end of 2025, cities at the prefecture level and above should basically have a garbage classification and treatment system.

However, at present, domestic residents still have problems in the degree of participation and the accuracy of classification in the classification and delivery of domestic waste. Specifically, it is highlighted in the following two aspects:

First, garbage classification standards are different. Examples of known local classification standards are as follows:

Five categories of kitchen waste (wet) waste, hazardous waste, bulky waste, recyclables, and other waste;

Organic waste (kitchen waste, spoiled food, etc.), inorganic waste (glass bottles, cans, iron, waste paper and rubber and plastic products, etc.) and toxic and harmful waste (expired medicines, waste batteries, residual paint, waste lamps, etc.);

Recyclable waste, kitchen waste, hazardous waste and other waste;

Beverage bottles, waste paper, metal, textile, plastic, glass, kitchen waste, hazardous waste;

Second, the degree of enthusiasm and accuracy needs to be further improved. Due to the lack of supervision and incentives, and the complex and diverse types of garbage, in daily life, the classification and delivery of garbage mainly depends on the user's consciousness, and the accuracy is insufficient.

In response to the above situation, with the help of the development of image recognition and artificial intelligence technology, domestic and foreign research institutions and companies have proposed image recognition-based garbage classification guidance technology: such as the Oscar garbage classification system developed by Intuitive AI, equipped with a 32-inch display screen and artificial intelligence A camera, which can recognize the items in your hand and tell you how to handle them correctly, and can give interesting hints about whether the delivery is correct or not, the system is tested at an airport in Vancouver, Canada, as well as at Simon Fraser University; Guangdong Digital Phase Intelligent Technology Co., Ltd. proposed "a garbage classification prompting device and system based on image recognition", including a garbage sorting prompting screen (including a camera, an information processor, a display module and a power supply module). Jinan University proposes an "Internet-based garbage sorting and recycling system and garbage sorting terminal", including garbage sorting terminals, special scanning equipment for cleaners, client terminal, system administrator terminal, garbage recycling operation management platform and remote server. .

Judging from the practice at home and abroad, the above technologies or systems still have the following problems: First, most of them require on-site customization or addition of special equipment, such as cameras and screen prompting devices, resulting in high on-site implementation costs; Second, there is a lack of mobilizing users to actively classify according to guidance positivity. Therefore, how to carry out flexible waste classification methods and positive incentives for different places is the core and effective means to improve the level of waste classification and treatment.

SUMMARY OF THE INVENTION

According to the current situation that garbage classification standards cannot be unified nor suitable for unification, this application fully reuses urban municipal lighting intelligent composite poles, adopts image recognition, artificial intelligence and human-computer interaction technologies, and proposes a life based on image recognition and point rewards. Disclosed are a system and method for sorting and throwing garbage. The system is a combined device for sorting and throwing garbage based on the combination of intelligent lighting poles and sorting garbage bins, focusing on solving the problems of high cost of guidance devices for sorting and throwing garbage, and insufficient user experience and enthusiasm for sorting and throwing.

In order to achieve the above goals, the first invention of the present application adopts the following technical solutions:

A garbage classification and delivery system based on image recognition and reward points, aiming at domestic waste, the garbage classification and delivery system includes a garbage classification and delivery bin, an intelligent composite pole, a waste classification and delivery management and control system, and a waste delivery point management APP;

The classified garbage bins are used for classifying and storing garbage, and a garbage identification area to be placed is marked next to the classified garbage bins, and the garbage identification area to be placed is a designated standing area for garbage placement;

The classified garbage bin is installed near the intelligent composite pole, and an intelligent camera and a prompt device are installed on the intelligent composite pole;

The shooting range of the intelligent camera covers the classified garbage bins and the identification area for garbage to be placed, and is used to collect and identify the real-time image information of the classified garbage bins and the identification area for garbage to be placed;

The prompting device is used to prompt garbage classification and delivery information;

The garbage classification and delivery management and control system is used to carry out garbage classification and delivery management and control based on the real-time image information of the classified and released garbage bins and the identification area of the garbage to be released, which are collected and recognized by the intelligent camera;

The garbage distribution point management APP is bound to the face information of the garbage distributor, and is used for the display and management of garbage distribution points.

The present invention further includes the following preferred solutions:

The intelligent camera includes a collection module, a judgment module, a face recognition module, a garbage type recognition module and a tracking module;

The collection module is used to collect real-time image information of the classified garbage bin and the identification area of the garbage to be thrown;

The judging module is used for judging whether there is garbage entering the garbage identification area to be thrown based on the real-time image information of the garbage identification area collected by the collection module. Type identification module and tracking module;

The face recognition module is used to identify the garbage dumper and determine whether the garbage dumper has been registered with the garbage dump point management APP, if not, the prompt device will prompt the garbage dumper to register the garbage dump point management APP to complete the face binding;

The garbage type identification module is used to identify the garbage type to be put in, and the garbage type is displayed by a prompt device;

The tracking module is used to control the intelligent camera to track and perceive the delivery process. If the type of garbage to be placed matches the garbage bin into which it is placed, the garbage distribution point management APP will reward the garbage dumper with points and automatically accumulate them into the garbage dumper. Points account; otherwise, the prompting device will prompt the placement error message.

Preferably, the garbage classification and delivery management and control system includes a synchronization module, a transmission module and a management module;

The synchronization module is used to manage the garbage standard classification template, so that the garbage classification standard is consistent with the garbage identification type of the smart camera;

The transmission module is used to realize the information transmission from the smart camera to the person who put it through the prompting device.

The management module is used to manage user files and perform point calculation and reward.

Preferably, the garbage classification and delivery management and control system further includes a monitoring module;

The monitoring module is used for regularly monitoring the storage status of the classified and dropped waste bins based on the real-time image information of the classified and dropped waste bins collected and identified by the smart camera, and if the bins are nearly full, the waste collection vehicles are dispatched for recycling and disposal.

Preferably, the garbage classification and delivery management and control system further includes an adjustment module;

The adjustment module is used for adjusting the number and categories of garbage sorting bins according to the throwing rule of the garbage throwing bins.

Preferably, a see-through rain-proof top cover is used for the classified throwing garbage bin, which is convenient for throwing garbage from the upper part and identifying the storage state of the garbage through a smart camera.

Preferably, the prompting device includes an information display screen and an audio device, which are respectively used for graphical interface prompting and voice prompting;

Information display screen, which is used to display the information of garbage distribution points management APP users who scan the QR code, garbage type and distribution error information;

The audio equipment is used for prompting garbage type and throwing error information.

The present application also discloses another invention, that is, a method for classifying and placing garbage based on image recognition and reward points. For domestic garbage, the method for classifying and placing garbage includes the following steps:

Step 1: The smart camera collects the real-time image information of the classified garbage bins and the identification area of the garbage to be placed;

Step 2: Based on the real-time image information of the garbage identification area to be placed collected by the smart camera, determine whether there is garbage entering the garbage identification area to be placed. When there is garbage entering the garbage identification area to be placed, step 3 is performed;

Step 3: Identify the garbage dumper and determine whether it has registered the garbage dump point management APP. If not, the garbage dumper will be prompted to register the garbage dump point management APP to complete the face binding;

Step 4: Identify and display the type of garbage to be placed;

Step 5: The smart camera tracks and perceives the delivery process. If the type of garbage to be placed matches the garbage bin in which it is placed, the garbage distribution point management APP will reward the garbage distributor and automatically accumulate points into the garbage distributor's point account; otherwise, Prompt to serve an error message.

Preferably, the method further includes, based on the collected and identified real-time image information of the sorted and put-in waste bins, regularly monitoring the storage status of the sorted and put-in waste bins, and if the bins are nearly full, dispatching garbage collection vehicles for recycling and disposal.

Preferably, the method further includes adjusting the number and category of garbage sorting bins in each place according to the regularity of placing garbage in each place.

Preferably, the prompting method includes graphical interface prompting and voice prompting.

The beneficial effects achieved by this application:

1. This application uses the municipal street light intelligent composite poles nearby for image recognition and classification guidance, and does not add a garbage classification guidance device, which reduces the cost and accuracy of garbage classification and delivery;

2. This application rewards users with points for correct placement, which improves the enthusiasm of users for classified placement.

Description of drawings

1 is a schematic structural diagram of a garbage classification and delivery system based on image recognition and integral reward of the present application;

Fig. 2 is the schematic diagram of the positional relationship between the classified and thrown garbage bin of the present application and the identification area of the garbage to be thrown;

FIG. 3 is a flowchart of a method for classifying and placing garbage based on image recognition and point reward according to the present application.

Detailed ways

The present application will be further described below with reference to the accompanying drawings. The following examples are only used to more clearly illustrate the technical solutions of the present invention, and cannot be used to limit the protection scope of the present application.

As shown in FIG. 1 , a garbage classification and delivery system based on image recognition and integral reward of the present application, for domestic garbage, the garbage classification and delivery system includes classified and thrown garbage bins, intelligent composite poles, garbage classification and delivery management and control systems and Garbage Disposal Points Management APP;

As shown in FIG. 2 , the classified garbage bins are used for classifying and storing garbage, and a garbage identification area to be placed is marked next to the classified garbage bins, and the garbage identification area to be placed is a designated standing area for garbage placement;

In an embodiment, the classified throwing garbage bin adopts a see-through rainproof top cover, which is convenient for throwing garbage from the top and for identifying the storage state of the garbage through a smart camera.

The classified garbage bin is installed near the intelligent composite pole, and an intelligent camera and a prompt device are installed on the intelligent composite pole;

The shooting range of the intelligent camera covers the classified garbage bins and the identification area for garbage to be placed, and is used to collect and identify the real-time image information of the classified garbage bins and the identification area for garbage to be placed;

The prompting device is used to prompt garbage classification and delivery information;

In an embodiment, the prompting device includes an information display screen and an audio device, which are respectively used for graphical interface prompting and voice prompting;

Information display screen, which is used to display the information of garbage distribution points management APP users who scan the QR code, garbage type and distribution error information;

The audio equipment is used for prompting garbage type and throwing error information.

The garbage classification and delivery management and control system is used to carry out garbage classification and delivery management and control based on the real-time image information of the classified and released garbage bins and the identification area of the garbage to be released, which are collected and recognized by the intelligent camera;

The garbage distribution point management APP is bound to the face information of the garbage distributor, and is used for the display and management of garbage distribution points.

In an embodiment, the smart camera includes a collection module, a judgment module, a face recognition module, a garbage type recognition module and a tracking module;

The collection module is used to collect real-time image information of the classified garbage bin and the identification area of the garbage to be thrown;

The judging module is used for judging whether there is garbage entering the garbage identification area to be thrown based on the real-time image information of the garbage identification area collected by the collection module. Type identification module and tracking module;

The face recognition module is used to identify the garbage dumper based on the Tonggu face recognition technology, and determine whether he has registered the garbage dump credit management APP, if not, the prompting device prompts the garbage dumper to register the garbage dump credit management APP, Complete face binding;

In the embodiment, if the garbage dumper does not register the garbage dumping credit management APP and does not dump garbage according to the classification standard, the face recognition module will report the identified garbage dumper to the corresponding management department.

The garbage type identification module is used to identify the garbage type to be put in, and the garbage type is displayed by a prompt device;

The tracking module is used to control the intelligent camera to track and perceive the delivery process. If the type of garbage to be placed matches the garbage bin into which it is placed, the garbage distribution point management APP will reward the garbage dumper with points and automatically accumulate them into the garbage dumper. Points account; otherwise, the prompting device will prompt an error message, and the garbage distribution point management APP will not count or even deduct points for the garbage distributor.

In an embodiment, the garbage classification and delivery management and control system includes a synchronization module, a transmission module and a management module;

The synchronization module is used to manage the garbage standard classification template, so that the garbage classification standard is consistent with the garbage identification type of the smart camera;

The transmission module is used to realize the information transmission of the intelligent camera to the thrower through the prompting device, that is, according to the recognition result of the intelligent camera, the human-computer interaction is carried out to the garbage thrower through the information display screen and the speaker device;

The management module is used to manage user files and perform point calculation and reward.

In an embodiment, the garbage classification and delivery management and control system further includes a monitoring module and an adjustment module;

The monitoring module is used for regularly monitoring the storage status of the classified and dropped waste bins based on the real-time image information of the classified and dropped waste bins collected and identified by the smart camera, and if the bins are nearly full, the waste collection vehicles are dispatched for recycling and disposal.

The adjustment module is used for adjusting the number and categories of garbage sorting bins according to the throwing rule of the garbage throwing bins.

As shown in FIG. 3 , a method for classifying and placing garbage based on image recognition and reward points of the present application, for domestic garbage, the method for classifying and placing garbage includes the following steps:

Step 1: The collection module of the smart camera collects the real-time image information of the classified garbage bins and the identification area of the garbage to be placed;

Step 2: Based on the real-time image information of the garbage identification area (recognition area) collected by the intelligent camera, the judgment module of the intelligent camera determines whether there is garbage entering the garbage identification area to be placed, and when there is garbage entering the garbage identification area to be placed, execute the steps 3;

Step 3: The face recognition module of the smart camera identifies the garbage dumper and judges whether he or she has registered the garbage dump point management APP. If not, the information display screen (information release screen) will display the garbage dump point management APP and scan the QR code. Prompt the garbage dumper to register the garbage dump point management APP to complete the face binding;

Step 4: The garbage type identification module of the smart camera identifies the garbage type to be put in, and the prompt device prompts the garbage type;

Step 5: The tracking module of the smart camera tracks and perceives the delivery process. If the type of garbage to be placed matches the garbage bin it is placed in, the garbage distribution point management APP will reward the garbage distributor with points and automatically accumulate it into the garbage distributor's points account. ; otherwise, the prompting device prompts the delivery error message.

In an embodiment, the method for classifying and throwing garbage further includes:

Based on the real-time image information collected and identified by the smart camera, the monitoring module of the garbage sorting and delivery management and control system regularly monitors the storage status of the sorted and thrown waste bins.

The adjustment module of the garbage classification and delivery management and control system adjusts the number and category of each garbage classification box according to the distribution rules of the garbage delivery boxes.

In an embodiment, the prompting method includes graphical interface prompting and voice prompting.

The applicant of the present invention has described and described the embodiments of the present invention in detail with reference to the accompanying drawings, but those skilled in the art should understand that the above embodiments are only preferred embodiments of the present invention, and the detailed description is only to help readers better Rather, any improvement or modification based on the spirit of the present invention should fall within the protection scope of the present invention.

Claims (10)

1. a garbage classification and delivery system based on image recognition and integral reward, for domestic garbage, is characterized in that: The garbage classification and delivery system includes classified garbage bins, intelligent composite poles, a garbage classification and distribution management and control system, and a garbage distribution point management APP; The classified garbage bins are used for classifying and storing garbage, and a garbage identification area to be placed is marked next to the classified garbage bins, and the garbage identification area to be placed is a designated standing area for garbage placement; The classified garbage bin is installed near the intelligent composite pole, and an intelligent camera and a prompt device are installed on the intelligent composite pole; The shooting range of the intelligent camera covers the classified garbage bins and the identification area for garbage to be placed, and is used to collect and identify the real-time image information of the classified garbage bins and the identification area for garbage to be placed; The prompting device is used to prompt garbage classification and delivery information; The garbage classification and delivery management and control system is used to carry out garbage classification and delivery management and control based on the real-time image information of the classified and released garbage bins and the identification area of the garbage to be released, which are collected and recognized by the intelligent camera; The garbage distribution point management APP is bound to the face information of the garbage distributor, and is used for the display and management of garbage distribution points. 2. a kind of garbage classification and delivery system based on image recognition and integral reward according to claim 1, is characterized in that: The intelligent camera includes a collection module, a judgment module, a face recognition module, a garbage type recognition module and a tracking module; The collection module is used to collect real-time image information of the classified garbage bin and the identification area of the garbage to be thrown; The judging module is used to judge whether there is garbage entering the garbage identification area to be thrown based on the real-time image information of the garbage identification area collected by the collection module. Type identification module and tracking module; The face recognition module is used to identify the garbage dumper and determine whether the garbage dumper has been registered with the garbage dump point management APP, if not, the prompt device will prompt the garbage dumper to register the garbage dump point management APP to complete the face binding; The garbage type identification module is used to identify the garbage type to be put in, and the garbage type is displayed by a prompt device; The tracking module is used to control the intelligent camera to track and perceive the delivery process. If the type of garbage to be placed matches the garbage bin into which it is placed, the garbage distribution point management APP will reward the garbage dumper with points and automatically accumulate them into the garbage dumper. Points account; otherwise, the prompting device will prompt the placement error message. 3. a kind of garbage classification and delivery system based on image recognition and integral reward according to claim 1, is characterized in that: The garbage classification and delivery management and control system includes a synchronization module, a transmission module and a management module; The synchronization module is used to manage the garbage standard classification template, so that the garbage classification standard is consistent with the garbage identification type of the smart camera; The transmission module is used to realize the information transmission of the smart camera to the person who delivers it through the prompting device; The management module is used to manage user files and perform point calculation and reward. 4. a kind of garbage classification and delivery system based on image recognition and integral reward according to claim 3, is characterized in that: The garbage classification and delivery management and control system further includes a monitoring module; The monitoring module is used for regularly monitoring the storage status of the classified and dropped waste bins based on the real-time image information of the classified and dropped waste bins collected and identified by the smart camera, and if the bins are nearly full, the waste collection vehicles are dispatched for recycling and disposal. 5. a kind of garbage classification and delivery system based on image recognition and integral reward according to claim 3, is characterized in that: The garbage classification and delivery management and control system further includes an adjustment module; The adjustment module is used for adjusting the number and categories of garbage sorting bins according to the throwing rule of the garbage throwing bins. 6. a kind of garbage classification and delivery system based on image recognition and integral reward according to any one of claims 1-5, is characterized in that: The classified throwing garbage bin adopts a see-through rain-proof top cover, which is convenient for throwing garbage from the upper part and identifying the storage state of the garbage through a smart camera. 7. a kind of garbage classification and delivery system based on image recognition and integral reward according to any one of claims 1-5, is characterized in that: The prompting device includes an information display screen and an audio device, which are respectively used for graphical interface prompting and voice prompting; Information display screen, which is used to display the information of garbage distribution points management APP users who scan the QR code, garbage type and distribution error information; The audio equipment is used for prompting garbage type and throwing error information. 8. A garbage classification and delivery method based on image recognition and integral reward, for domestic garbage, characterized in that: The method for classifying and throwing garbage includes the following steps: Step 1: Collect the real-time image information of the classified garbage bins and the identification area of the garbage to be placed; Step 2: Based on the collected real-time image information of the garbage identification area to be placed, determine whether there is garbage entering the garbage identification area to be placed, and when there is garbage entering the garbage identification area to be placed, step 3 is performed; Step 3: Identify the garbage dumper and determine whether it has registered the garbage dump point management APP. If not, the garbage dumper will be prompted to register the garbage dump point management APP to complete the face binding; Step 4: Identify and display the type of garbage to be placed; Step 5: Track and perceive the delivery process. If the type of garbage to be placed matches the garbage bin it is placed in, the garbage distribution point management APP will reward the garbage distributor with points and automatically accumulate it into the garbage distributor's points account; otherwise, prompt delivery error message. 9. a kind of garbage classification and throwing method based on image recognition and integral reward according to claim 8, is characterized in that: The method also includes: Based on the collected and identified real-time image information of the sorted garbage bins, regularly monitor the storage status of the sorted garbage bins. If the bins are nearly full, the garbage collection vehicles will be dispatched for recycling and disposal; Adjust the number and type of garbage sorting bins according to the regularity of the garbage disposal bins. 10. a kind of garbage classification and throwing method based on image recognition and point reward according to any one of claims 7-9, is characterized in that: The prompting method includes graphical interface prompting and voice prompting.

Images