CN111439503B - Automatic classification system and method for garbage in vehicle - Google Patents

Automatic classification system and method for garbage in vehicle Download PDF

Info

Publication number
CN111439503B
CN111439503B CN202010339640.0A CN202010339640A CN111439503B CN 111439503 B CN111439503 B CN 111439503B CN 202010339640 A CN202010339640 A CN 202010339640A CN 111439503 B CN111439503 B CN 111439503B
Authority
CN
China
Prior art keywords
garbage
driver
vehicle
module
automobile
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010339640.0A
Other languages
Chinese (zh)
Other versions
CN111439503A (en
Inventor
胡昶
王夕
刘倩
邹淼淼
马泽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dongfeng Motor Corp
Original Assignee
Dongfeng Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dongfeng Motor Corp filed Critical Dongfeng Motor Corp
Priority to CN202010339640.0A priority Critical patent/CN111439503B/en
Publication of CN111439503A publication Critical patent/CN111439503A/en
Application granted granted Critical
Publication of CN111439503B publication Critical patent/CN111439503B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
    • B65F1/00—Refuse receptacles; Accessories therefor
    • B65F1/14—Other constructional features; Accessories
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
    • B65F1/00—Refuse receptacles; Accessories therefor
    • B65F1/0033—Refuse receptacles; Accessories therefor specially adapted for segregated refuse collecting, e.g. receptacles with several compartments; Combination of receptacles
    • B65F1/0053—Combination of several receptacles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
    • B65F1/00—Refuse receptacles; Accessories therefor
    • B65F1/14—Other constructional features; Accessories
    • B65F1/16—Lids or covers
    • B65F1/1623—Lids or covers with means for assisting the opening or closing thereof, e.g. springs
    • B65F1/1638—Electromechanically operated lids
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/40—Bus networks
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
    • B65F2210/00—Equipment of refuse receptacles
    • B65F2210/138—Identification means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
    • B65F2210/00—Equipment of refuse receptacles
    • B65F2210/176—Sorting means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
    • B65F2210/00—Equipment of refuse receptacles
    • B65F2210/178—Steps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/40—Bus networks
    • H04L2012/40208—Bus networks characterized by the use of a particular bus standard
    • H04L2012/40215—Controller Area Network CAN
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/40—Bus networks
    • H04L2012/40267—Bus for use in transportation systems
    • H04L2012/40273—Bus for use in transportation systems the transportation system being a vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Electromagnetism (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Refuse-Collection Vehicles (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses an automatic classification system and method for garbage in a vehicle, which relate to the field of environmental protection, and comprise a vehicle detection module, an eye tracking module, a radar module and a gesture recognition module, wherein the vehicle detection module is used for being connected with a vehicle CAN bus so as to acquire the driving state of the vehicle; the eye tracking module is used for tracking the eyeballs of the automobile driver so as to judge whether the sight of the driver is over against the front of the automobile; the radar module is used for judging whether other vehicles and pedestrians exist in a preset range around the automobile; the gesture recognition module is used for recognizing hand movements of a driver, and when the gesture recognition module recognizes the hand movements of the driver as garbage throwing movements, output signals of the vehicle detection module, the eye tracking module and the radar module are acquired. The invention can effectively ensure the driving safety of the vehicle while realizing the classification of the garbage generated by the driver in the driving process of the vehicle.

Description

Automatic classification system and method for garbage in vehicle
Technical Field
The invention relates to the field of environmental protection, in particular to an automatic classification system and method for garbage in a vehicle.
Background
The garbage classification is an improvement of the traditional garbage collection and disposal mode, and is a scientific management method for effectively disposing garbage. At present, in the situation that the increasing garbage yield and the environmental condition are worsened, how to realize the utilization of garbage resources to the maximum extent through garbage classification management, reduce the garbage disposal amount and improve the living environment quality is one of the urgent problems which are commonly concerned by countries in the world at present. At present, local laws and regulations for garbage classification are provided in 30 cities in China, and garbage classification is put into a legislative plan in 16 cities. The garbage classified collection can reduce the garbage treatment amount and treatment equipment, reduce the garbage treatment cost, reduce the consumption of land resources and have social, economic and ecological benefits.
For the garbage generated in home life, people can classify at home, the process of driving a vehicle by a driver is a dynamic and unstable state, and the driver is easily influenced by other interference to cause traffic accidents. However, when a driver drives a vehicle, garbage to be discarded may be generated due to some reasons, and the driver is in a vehicle driving state, and the generated garbage is often discarded after classifying the garbage without time and attention, so that it is difficult for the vehicle driver to classify the garbage.
The patent with the application number of CN107034821A and the name of 'an integrated machine for storing garbage integrating movement, positioning and cleaning' discloses a vehicle garbage collection device, which comprises a cockpit and a garbage carriage, wherein the cockpit is connected with the garbage carriage in a clamping manner, and the vehicle garbage collection device further comprises a control module, a GPS module, a power module and the like. But it only provides a scheme for collecting garbage outside the vehicle and still does not realize the classified collection treatment of the garbage in the vehicle.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide an automatic classification system for garbage in a vehicle, which can effectively ensure the driving safety of the vehicle while realizing the classification of the garbage generated by a driver in the driving process of the vehicle.
In order to achieve the above purposes, the technical scheme adopted by the invention is as follows:
the vehicle detection module is used for being connected with an automobile CAN bus so as to acquire the running state of an automobile;
the eye tracking module is used for tracking eyeballs of a driver of the automobile so as to judge whether the sight of the driver is over against the front of the automobile;
the radar module is used for judging whether other vehicles and pedestrians exist in a preset range around the automobile;
the gesture recognition module is used for recognizing hand movements of a driver, acquiring output signals of the vehicle detection module, the eye tracking module and the radar module when the gesture recognition module recognizes the hand movements of the driver as garbage throwing movements, and driving the garbage bin in the vehicle to be opened if the sight of the driver is over against the front of the vehicle and other vehicles and pedestrians exist in a preset range around the vehicle when the vehicle is in a driving state on the basis of the output signals;
the garbage classification module is used for classifying garbage thrown into the garbage can in the vehicle by a driver.
On the basis of the technical proposal, the device comprises a shell,
the eye tracking module comprises a camera arranged above the instrument panel;
the eye tracking module is specifically used for identifying the eyeball state of the driver in the eye picture by adopting an eyeball tracking technology based on the eye picture of the driver shot by the camera so as to judge whether the sight line of the driver is over against the front.
On the basis of the technical scheme, the in-vehicle dustbin is positioned between the front seats of the automobile, a plurality of rubbish storage slots are arranged in the in-vehicle dustbin, and each rubbish storage slot is used for storing rubbish of one type.
On the basis of the technical proposal, the device comprises a shell,
the garbage classification module comprises a garbage identification module and a mechanical arm which are arranged in a garbage can in the vehicle;
the rubbish identification module is used for discerning the back to the rubbish that the driver throws into in the car dustbin, based on the kind of rubbish, orders about the arm and deposits corresponding rubbish in and deposits the trench.
On the basis of the technical scheme, the garbage truck garbage can further comprises an image processing module and an image display module, wherein the image processing module is used for performing three-dimensional processing on images of garbage thrown into the garbage can by a driver to obtain three-dimensional images, and then the image display module presents the three-dimensional images on a box cover of the garbage can in the vehicle in a 3D projection mode to prompt the driver that the garbage is stored in the garbage can in the vehicle.
On the basis of the technical scheme, the garbage truck further comprises a voice module, wherein the voice module is used for prompting a driver to take garbage in the garbage truck away from the automobile in a voice mode when the automobile driving state acquired by the automobile detection module is stopped.
The invention provides an automatic classification method of in-vehicle garbage, which is based on the automatic classification system of in-vehicle garbage and comprises the following steps:
the gesture recognition module is used for recognizing the hand action of the driver in real time;
the gesture recognition module is used for acquiring output signals of the vehicle detection module, the eye tracking module and the radar module when recognizing the hand movement of the driver as a garbage throwing movement;
based on the output signal, when the driving state of the automobile is in driving, if the sight of a driver is over against the front of the automobile and other vehicles and pedestrians exist in a preset range around the automobile, the in-automobile dustbin is driven to be opened, and when the driving state of the automobile is stopped, the in-automobile dustbin is directly driven to be opened;
the garbage thrown into the garbage can in the vehicle by the driver is classified.
On the basis of the scheme, the specific judgment step that the sight of the driver is over against the front of the automobile is as follows:
the camera arranged above the instrument panel is used for shooting the eye image of the driver, and then the eyeball tracking technology is adopted to identify the eyeball state of the driver in the eye image so as to judge whether the sight of the driver is over against the front.
On the basis of the scheme, the in-vehicle dustbin is positioned between the front seats of the automobile, a plurality of rubbish storage slots are arranged in the in-vehicle dustbin, and each rubbish storage slot is used for storing rubbish of one type.
On the basis of the scheme, the garbage thrown into the garbage can in the vehicle by the driver is classified, and the method specifically comprises the following steps:
adopt image recognition technology to discern the rubbish that the driver throws into in the car dustbin, then based on the rubbish kind that the discernment obtained, order about the arm and deposit rubbish in corresponding rubbish and deposit the trench.
Compared with the prior art, the invention has the advantages that: when a vehicle driver needs to throw garbage, the output signals of the vehicle detection module, the eye tracking module and the radar module are acquired, based on the output signals, if and only if the driving state of the vehicle is in driving, the sight of the driver is over against the front of the vehicle and other vehicles and pedestrians exist in the preset range around the vehicle, the garbage can in the vehicle is driven to be opened, the garbage thrown by the driver is classified, and the driving safety of the vehicle can be effectively guaranteed while the garbage produced by the driver in the driving process of the vehicle is classified.
Drawings
FIG. 1 is a schematic diagram of an automatic classification system for vehicle interior garbage according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating the installation positions of the components of an automatic classification system for vehicle interior garbage according to an embodiment of the present invention;
FIG. 3 is a schematic structural view of an in-vehicle trash can according to an embodiment of the present invention;
fig. 4 is a flowchart of an automatic classification method for in-vehicle garbage according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides an automatic classification system for garbage in a vehicle, which can classify the garbage generated by a driver in the driving process of the vehicle and can effectively ensure the driving safety of the vehicle. The embodiment of the invention correspondingly provides an automatic classification method for the garbage in the vehicle. The present invention will be described in further detail with reference to the accompanying drawings and examples.
Referring to fig. 1, an automatic classification system for in-vehicle garbage according to an embodiment of the present invention includes a vehicle detection module, an eye tracking module, a radar module, and a gesture recognition module.
The vehicle detection module is used for being connected with a Controller Area Network (CAN) bus of the vehicle to acquire the driving state of the vehicle. The CAN bus contains the current speed data of the automobile, and the vehicle detection module acquires the speed data of the automobile by connecting with the CAN bus, so that the current driving state of the automobile CAN be judged according to the speed data, wherein the driving state comprises driving and stopping.
The eye tracking module is used for tracking the eyeballs of the automobile driver so as to judge whether the sight of the driver is over against the front of the automobile. The eye tracking module is used for detecting the sight of a driver, the installation position of the eye tracking module can be shown in fig. 2, the position I in fig. 2 is the installation position of the eye tracking module, the eye tracking module comprises a camera installed above an instrument panel, the eye tracking module is specifically used for identifying the eyeball state of the driver in an eye picture based on the eye picture of the driver shot by the camera, and then the eyeball tracking technology is adopted to judge whether the sight of the driver is over against the front. The eyeball tracking technology is mature at present, the direction of sight is known by identifying eyeballs, and the sight direction of a driver is known by the eyeball tracking technology.
The radar module is used for judging whether other vehicles and pedestrians exist in the preset range around the automobile. In order to guarantee driving safety, the preset range around the automobile can be set to be 50 meters around, 2 meters around, and the radar detection technology is mature, and the existing middle-high-end automobile is provided with the radar detection technology, and whether other vehicles and pedestrians exist around the automobile is judged through the technology.
The gesture recognition module is used for recognizing the hand action of the driver, when the gesture recognition module recognizes the hand action of the driver as the garbage throwing action, the output signals of the vehicle detection module, the eye tracking module and the radar module are acquired, based on the output signals, when the automobile driving state is in driving, if the sight of the driver is just opposite to the front of the automobile and other vehicles and pedestrians exist in the preset range around the automobile, the garbage can in the automobile is driven to be opened, and when the automobile driving state is stopped, the garbage can in the automobile is directly driven to be opened. The dustbin is located between the front row seats of the automobile. Referring to fig. 2, the installation position of the gesture recognition module in the embodiment of the present invention is position two in fig. 2. The gesture recognition module is used for realizing hand actions based on a neural network model, firstly collecting hand actions of a plurality of drivers for throwing garbage, inputting the hand actions into the neural network model, training the neural network model, enabling the neural network model to have the capability of recognizing the hand actions of the drivers, and then recognizing the hand actions of the drivers for throwing the garbage.
When the automobile is in a driving state, if the sight of the driver is over against the front of the automobile and other vehicles and pedestrians exist in a preset range around the automobile, the garbage can in the automobile is opened, the driver is allowed to throw garbage into the garbage can in the automobile, and the driving safety of the automobile in the garbage throwing process of the driver is effectively ensured.
The garbage classification module is arranged in the garbage can in the vehicle and is used for classifying garbage thrown into the garbage can in the vehicle by a driver. Referring to fig. 2, the third position in fig. 2 is the in-vehicle dustbin, and referring to fig. 3, the in-vehicle dustbin is a specific structure, a plurality of rubbish storage slots are arranged in the in-vehicle dustbin, and each rubbish storage slot is used for storing one type of rubbish. The garbage classification module is including locating rubbish identification module and the arm in the dustbin in the car, and rubbish identification module is used for discerning the back to the rubbish that the driver throws into in the dustbin, and based on the kind of rubbish, orders about the arm and deposits corresponding rubbish in and deposit the trench. In fig. 3, the symbol (c) indicates a mechanical arm, the symbol (c) indicates a rotating mechanism, the symbol (c) indicates a trash recognition module, and the symbol (b) indicates a cover of a trash can in the vehicle.
The rubbish kind that produces in the car is generally comparatively single, is wrapping bag or paper handkerchief usually, and simultaneously, rubbish identification module can realize based on the neural network model, in advance through training the neural network model to rubbish identification module can discern rubbish kind.
The automatic classification system for the garbage in the vehicle further comprises an image processing module, an image display module and a voice module, wherein the image processing module is used for performing three-dimensional processing on images of the garbage thrown into the garbage can in the vehicle by a driver to obtain three-dimensional images, and then the image display module presents the three-dimensional images on a box cover of the garbage can in the vehicle in a 3D projection mode to prompt the driver that the garbage is stored in the garbage can in the vehicle. Furthermore, the box cover of the garbage can in the vehicle can be integrated with the holographic projection display screen, so that a driver can be informed of the fact that garbage is thrown into the garbage can in the vehicle conveniently in an image mode. The voice module is used for prompting a driver to take the garbage in the garbage can in the automobile away from the automobile in a voice mode when the automobile running state acquired by the automobile detection module is stopped. The voice module is located at position (r) in fig. 2.
According to the automatic classification system for the garbage in the vehicle, disclosed by the embodiment of the invention, when a vehicle driver has a garbage throwing requirement, output signals of the vehicle detection module, the eye tracking module and the radar module are obtained, and based on the output signals, when and only when the driving state of the vehicle is in a driving state, the sight of the driver is over against the front of the vehicle and other vehicles and pedestrians exist in a preset range around the vehicle, the garbage can in the vehicle is driven to be opened, the garbage thrown by the driver is classified, the classification of the garbage generated by the driver in the driving process of the vehicle is realized, and meanwhile, the driving safety of the vehicle can be effectively ensured.
Referring to fig. 4, an automatic classification method for in-vehicle garbage according to an embodiment of the present invention is based on the automatic in-vehicle garbage system, and the method includes the following steps:
s1: the gesture recognition module is used for recognizing the hand action of the driver in real time;
the method comprises the following steps that S2 when the gesture recognition module recognizes the hand movement of a driver as the garbage throwing movement, output signals of a vehicle detection module, an eye tracking module and a radar module are obtained;
s3: based on the output signal, when the driving state of the automobile is in driving, if the sight of a driver is over against the front of the automobile and other vehicles and pedestrians exist in a preset range around the automobile, the in-automobile dustbin is driven to be opened, and when the driving state of the automobile is stopped, the in-automobile dustbin is directly driven to be opened;
s4: the garbage thrown into the garbage can in the vehicle by the driver is classified.
In the embodiment of the invention, the specific judgment step that the sight of the driver is over against the front of the automobile comprises the following steps:
the camera arranged above the instrument panel is used for shooting the eye image of the driver, and then the eyeball tracking technology is adopted to identify the eyeball state of the driver in the eye image so as to judge whether the sight of the driver is over against the front.
In the embodiment of the invention, the in-vehicle dustbin is positioned between the front seats of the automobile, a plurality of rubbish storage groove positions are arranged in the in-vehicle dustbin, and each rubbish storage groove position is used for storing one type of rubbish.
In the embodiment of the invention, the garbage thrown into the garbage can in the vehicle by the driver is classified, and the method comprises the following specific steps:
adopt image recognition technology to discern the rubbish that the driver throws into in the car dustbin, then based on the rubbish kind that the discernment obtained, order about the arm and deposit rubbish in corresponding rubbish and deposit the trench.
According to the method for automatically classifying the garbage in the vehicle, disclosed by the embodiment of the invention, when a vehicle driver needs to throw the garbage, output signals of the vehicle detection module, the eye tracking module and the radar module are obtained, and based on the output signals, when and only when the driving state of the vehicle is in a driving state, the sight of the driver is over against the front of the vehicle and other vehicles and pedestrians exist in a preset range around the vehicle, the garbage can in the vehicle is driven to be opened, the garbage thrown by the driver is classified, the garbage generated by the driver in the driving process of the vehicle is classified, and meanwhile, the driving safety of the vehicle can be effectively ensured.

Claims (6)

1. An in-vehicle garbage automatic classification system is characterized by comprising:
the vehicle detection module is used for being connected with an automobile CAN bus so as to acquire the running state of an automobile;
the eye tracking module is used for tracking eyeballs of a driver of the automobile so as to judge whether the sight of the driver is over against the front of the automobile;
the radar module is used for judging whether other vehicles and pedestrians exist in a preset range around the automobile;
the gesture recognition module is used for recognizing hand movements of a driver, acquiring output signals of the vehicle detection module, the eye tracking module and the radar module when the gesture recognition module recognizes the hand movements of the driver as garbage throwing movements, and driving the garbage bin in the vehicle to be opened if the sight of the driver is over against the front of the vehicle and other vehicles and pedestrians exist in a preset range around the vehicle when the vehicle is in a driving state on the basis of the output signals;
the garbage classification module is used for classifying garbage thrown into the garbage can in the vehicle by a driver; the gesture recognition module is used for realizing hand actions based on a neural network model; the garbage identification module identifies the garbage types based on a neural network model;
the eye tracking module comprises a camera arranged above an instrument panel;
the eye tracking module is specifically used for identifying the eyeball state of the driver in the eye picture by adopting an eyeball tracking technology based on the eye picture of the driver shot by the camera so as to judge whether the sight of the driver is over against the front;
the in-vehicle dustbin is positioned between the front seats of the automobile, a plurality of rubbish storage groove positions are arranged in the in-vehicle dustbin, and each rubbish storage groove position is used for storing one type of rubbish;
the garbage classification module comprises a garbage identification module and a mechanical arm which are arranged in a garbage can in the vehicle;
the garbage recognition module is used for recognizing garbage thrown into a garbage can in the vehicle by a driver, and driving the mechanical arm to store the garbage into the corresponding garbage storage groove position based on the type of the garbage;
the garbage truck garbage can comprises a garbage bin cover, an image processing module, an image display module and a garbage bin control module, wherein the garbage bin cover is used for storing garbage in the garbage bin cover, the image processing module is used for performing three-dimensional processing on images of garbage thrown into the garbage bin in the garbage bin by a driver to obtain three-dimensional images, and then the image display module presents the three-dimensional images on the bin cover of the garbage bin in the garbage bin by adopting a 3D projection mode to prompt the driver that the garbage is stored in the garbage bin.
2. The automatic classification system of the garbage in the vehicle as claimed in claim 1, wherein: the automobile garbage collection device is characterized by further comprising a voice module, wherein the voice module is used for prompting a driver to take garbage in the garbage bin away from an automobile in a voice mode when the automobile driving state acquired by the automobile detection module is stopped.
3. An automatic classification method for in-vehicle garbage, based on the system of claim 1, is characterized by comprising the following steps:
the gesture recognition module is used for recognizing the hand action of the driver in real time;
the gesture recognition module is used for acquiring output signals of the vehicle detection module, the eye tracking module and the radar module when recognizing the hand movement of the driver as a garbage throwing movement;
based on the output signal, when the driving state of the automobile is in driving, if the sight of a driver is over against the front of the automobile and other vehicles and pedestrians exist in a preset range around the automobile, the in-automobile dustbin is driven to be opened, and when the driving state of the automobile is stopped, the in-automobile dustbin is directly driven to be opened;
the garbage thrown into the garbage can in the vehicle by the driver is classified.
4. The method for automatically classifying the garbage in the vehicle as claimed in claim 3, wherein the specific judgment step that the sight line of the driver is directly opposite to the front of the vehicle is:
the camera arranged above the instrument panel is used for shooting the eye image of the driver, and then the eyeball tracking technology is adopted to identify the eyeball state of the driver in the eye image so as to judge whether the sight of the driver is over against the front.
5. The automatic classification method of the garbage in the vehicle according to claim 4, characterized in that: the garbage bin is located between the front row of seats of the automobile, a plurality of garbage storage groove positions are arranged in the garbage bin, and each garbage storage groove position is used for storing garbage of one type.
6. The method for automatically sorting garbage in a vehicle according to claim 5, wherein the step of sorting the garbage thrown into the garbage bin by the driver comprises the following steps:
adopt image recognition technology to discern the rubbish that the driver throws into in the car dustbin, then based on the rubbish kind that the discernment obtained, order about the arm and deposit rubbish in corresponding rubbish and deposit the trench.
CN202010339640.0A 2020-04-26 2020-04-26 Automatic classification system and method for garbage in vehicle Active CN111439503B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010339640.0A CN111439503B (en) 2020-04-26 2020-04-26 Automatic classification system and method for garbage in vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010339640.0A CN111439503B (en) 2020-04-26 2020-04-26 Automatic classification system and method for garbage in vehicle

Publications (2)

Publication Number Publication Date
CN111439503A CN111439503A (en) 2020-07-24
CN111439503B true CN111439503B (en) 2021-08-06

Family

ID=71654701

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010339640.0A Active CN111439503B (en) 2020-04-26 2020-04-26 Automatic classification system and method for garbage in vehicle

Country Status (1)

Country Link
CN (1) CN111439503B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112173497A (en) * 2020-11-10 2021-01-05 珠海格力电器股份有限公司 Control method and device of garbage collection equipment

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108423004A (en) * 2018-05-16 2018-08-21 浙江吉利控股集团有限公司 A kind of binocular identification driver status detecting system and method
CN210192475U (en) * 2019-07-25 2020-03-27 程潇雅 Garbage classification type garbage truck
CN110471532B (en) * 2019-08-19 2023-04-18 业成科技（成都）有限公司 Vehicle-mounted device integrating eyeball tracking and gesture control
CN110697273B (en) * 2019-08-27 2023-12-01 酆雨舟 Household garbage intelligent recognition and automatic classification system and method based on iterative learning control

Also Published As

Publication number Publication date
CN111439503A (en) 2020-07-24

Similar Documents

Publication Publication Date Title
CN107967806B (en) Vehicle fake-license detection method, device, readable storage medium storing program for executing and electronic equipment
CN104103100B (en) Driving behavior analysis system
CN202077142U (en) Vehicle-mounted intelligent video detecting and analyzing system
CN110246365A (en) A kind of new-energy automobile charging pile parking stall based on machine vision is anti-to account for system
CN109145719B (en) Driver fatigue state identification method and system
CN106781685A (en) A kind of city intelligent shutdown system that robot is managed based on parking garage
CN102556043A (en) Automobile control system and automobile control method based on traffic light recognition
CN107600791A (en) Interactive automatic garbage classification collection box
CN106297314A (en) A kind of drive in the wrong direction or the detection method of line ball vehicle behavior, device and a kind of ball machine
CN104751600A (en) Anti-fatigue driving safety equipment based on iris recognition and application method thereof
CN204155450U (en) High definition bayonet apparatus on a kind of road
CN107226025A (en) A kind of system and method for real-time monitoring driving behavior
CN111439503B (en) Automatic classification system and method for garbage in vehicle
CN110351491A (en) A kind of low light compensation method according under environment, apparatus and system
CN112863244B (en) Method and device for promoting safe driving of vehicle
CN114120693A (en) Traffic light reminding system and method for vehicle and storage medium
CN108437837B (en) Management method for charging parking spaces of charging piles
CN206501782U (en) A kind of vehicle monitoring system
CN112581748A (en) Garage traffic-out pedestrian safety prompting system based on convolutional neural network
CN108932850A (en) A kind of record motor vehicle runs at a low speed the method and device of illegal activities
CN105096613A (en) Automobile overspeed brake and whistling snapshot system
CN113501004B (en) Control method and device based on gestures, electronic equipment and storage medium
CN105096607A (en) Intelligent traffic system capable of automatic control of automobile braking
CN103198669A (en) Video monitoring system in intelligent transportation system
CN201315096Y (en) Electronic police video system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant