KR102531237B1 - Method and device for nati-theft and cargo loading location notification by box truck artificial intelligence facial recognition - Google Patents

Abstract

An anti-theft and cargo loading location notification device by onboard vehicle artificial intelligence facial recognition is disclosed. A barcode scanner module that scans the barcode of the shipping box when loading and unloading a box truck; A fisheye camera module for photographing the driver and the delivery box at the rear when the warehouse is loaded and the delivery is out; Using the barcode scanned by the barcode scanner module and the driver and delivery box photographed by the fisheye camera module, real-time detection of theft of the delivery box in the vehicle, and real-time notification of theft of the delivery box if the delivery box is stolen as a result of the real-time detection theft detector; A driver's seat communicator receives a real-time notification of the theft detector and transmits a real-time notification result to the driver's smartphone in real time. According to the method and device for preventing theft and notifying cargo loading location by the above-mentioned AI facial recognition, the barcode information at the time of scanning the barcode and the driver's face photographed using a fisheye lens camera are photographed at the time of warehousing and loading of the delivery box. It is registered and configured to determine whether the delivery box matches the driver's face at the time of delivery, so that whether or not the delivery box is stolen can be detected in real time and notified to the driver.

Description

A method and device for preventing theft and notifying cargo loading location by AI facial recognition on boarding vehicles

The present invention relates to a method and device for preventing theft and notifying a cargo loading location, and more specifically, to a method and device for preventing theft and notifying a cargo loading location by artificial intelligence facial recognition of a box truck.

In many cases, trucks for courier deliveries leave their doors open.

There is a problem in that delivery boxes are often stolen while drivers deliver. In particular, there are frequent cases in which shipping boxes are taken while under the guise of scanning barcodes. However, even if the delivery box is stolen, there is no way to immediately detect or detect it.

In addition, the driver has to find and deliver the delivery box quickly, but there is a problem in that it is not easy to quickly find the delivery box among the numerous delivery boxes in the vehicle.

On the other hand, it is not uncommon for a driver to start a vehicle with the rear door open while busy working. It can lead to accidents as well as loss of courier boxes.

On the other hand, drivers often drive for a long time, and the amount of carbon dioxide in the vehicle increases, which sometimes reduces the driver's concentration.

Despite the existence of these various problems, it is difficult to easily solve these problems.

Registered Patent Publication 10-1927853 Registered Patent Publication 10-1927853

An object of the present invention is to provide a device for preventing theft and notifying a cargo loading location by onboard vehicle artificial intelligence facial recognition.

Another object of the present invention is to provide a method for preventing theft and notifying a cargo loading location by onboard vehicle artificial intelligence facial recognition.

According to the object of the present invention, the anti-theft and cargo loading position notification device by artificial intelligence facial recognition on boarding vehicle according to the object of the present invention is a barcode scanner module that scans the barcode of a delivery box when a box truck is stored in and loaded and shipped out; A fisheye camera module for photographing the driver and the delivery box at the rear when the warehouse is loaded and the delivery is out; Using the barcode scanned by the barcode scanner module and the driver and delivery box photographed by the fisheye camera module, real-time detection of theft of the delivery box in the vehicle, and real-time notification of theft of the delivery box if the delivery box is stolen as a result of the real-time detection theft detector; It may be configured to include a driver's seat communicator that receives a real-time notification of the theft detector and transmits a real-time notification result to the driver's smartphone in real time.

Here, a speaker module provided in the driver's seat of the vehicle; an LED module installed in a driver's seat of the vehicle; a door open sensor that detects an open rear door of the vehicle; an occupancy sensor for detecting whether a driver is occupied in the driver's seat of the vehicle; an acceleration sensor that detects whether the vehicle is running; When the door open sensor detects the rear door open, the occupancy sensor detects the occupancy of the driver and the acceleration sensor detects the operation of the vehicle, a warning message is output through the speaker module and the LED module is turned on. It may be configured to further include a sensor controller.

And it may be configured to further include a carbon dioxide detection sensor for detecting the amount of carbon dioxide in the driver's seat of the vehicle.

In this case, the sensor controller may be configured to output a warning message through the speaker module and turn on the LED module when the carbon dioxide detection sensor detects an amount of carbon dioxide equal to or greater than a predetermined standard.

Meanwhile, the burglar detector may include a barcode recognition module recognizing a barcode scanned by the barcode scanner module; a face recognition module for recognizing a driver's face photographed by the fisheye camera module; a delivery box recognition module for recognizing the shape of the delivery box photographed by the fisheye camera module; a delivery box tracking module for tracking the 3D location of the delivery box recognized by the delivery box recognition module within the loading space of the vehicle; a delivery box position specifying module for specifying a loading position of a delivery box according to a tracking result of the delivery box tracking module; It is configured to include a data storage module for each delivery box in which the face recognized by the face recognition module, the barcode information of the delivery box recognized by the barcode recognition module, and the loading position of the delivery box specified by the delivery box location specific module are stored. can

And the theft detector, when the barcode is recognized by the barcode recognition module, the recognized barcode information, the face of the driver recognized by the face recognition module at the time of recognition, and the location specified by the delivery box location specifying module at the time of recognition Check the loading position of the shipping box, check whether the checked barcode information is stored in the data storage module for each shipping box, and if the barcode information is stored as a result of the checking, the checked barcode information and face a barcode/face verification module that determines whether the face and barcode information stored in each data storage module match with each other; If it is determined that barcode information is not stored in the data storage module for each delivery box as a result of the check by the barcode/face verification module, the corresponding barcode information, face, and loading position are controlled to be stored in the data storage module for each delivery box. It may be configured to further include a data storage control module for each box.

Here, the barcode/face verification module, when it is determined that barcode information is stored as a result of the verification of the barcode/face verification module, barcode information in which the verified barcode information and face are stored in the data storage module for each delivery box. And it may be configured to determine whether the face and each match each other.

The barcode/face verification module determines that the barcode information and the driver's face identified by the barcode/face verification module do not match the barcode information stored in the data storage module for each delivery box and the driver's face, It may be configured to notify the driver's seat communicator of theft of a shipping box in real time.

When the barcode/face verification module determines that the barcode information and the driver's face identified by the barcode/face verification module match the barcode information stored in the data storage module for each delivery box and the driver's face, the It may be configured to extract the loading position of the corresponding delivery box stored in the data storage module for each delivery box and transmit it to the driver's seat communicator.

At this time, the driver's seat communicator may be configured to receive the loading position and transmit it to the driver's smart phone in real time.

According to another object of the present invention described above, the method for preventing theft and notifying the loading location of a cargo by artificial intelligence facial recognition is to scan the barcode of the delivery box when the barcode scanner module stores and loads the box truck and when it is shipped out. step; A fisheye camera module taking pictures of a rear driver and the delivery box at the time of warehousing and loading and delivery; detecting, by a theft detector, the theft of a delivery box in the vehicle in real time using the barcode scanned by the barcode scanner module and the driver and delivery box photographed by the fisheye camera module; If the delivery box is stolen as a result of the real-time detection, the theft detector notifies the driver's seat communication device of the delivery box theft in real time; The driver's seat communicator may be configured to receive a real-time notification of the theft detector and transmit a real-time notification result to the driver's smart phone in real time.

Here, in the step of the theft detector detecting the theft of the delivery box in real time using the barcode scanned by the barcode scanner module and the driver and the delivery box photographed by the fisheye camera module, the real-time detection result is not theft of the delivery box. if the theft detector extracts the loading position of the delivery box already stored in the theft detector, and transmits the extracted location to the driver's seat communicator; The driver's seat communicator may be configured to further include receiving the loading position and transmitting the loading position to the driver's smart phone in real time.

According to the method and device for preventing theft and notifying cargo loading location by the above-mentioned AI facial recognition, the barcode information at the time of scanning the barcode and the driver's face photographed using a fisheye lens camera are photographed at the time of warehousing and loading of the delivery box. It is registered and configured to determine whether the delivery box matches the driver's face at the time of delivery, so that whether or not the delivery box is stolen can be detected in real time and notified to the driver.

In addition, since it is configured to sense in real time that the vehicle is operating with the door open and notify the driver, there is an effect of preventing the driver from driving.

On the other hand, by detecting and notifying the amount of carbon dioxide in the driver's seat, there is an effect of preventing the driver from falling into a decrease in concentration while driving.

1 is a block configuration diagram of an apparatus for preventing theft and notifying a cargo loading location based on facial recognition of a vehicle artificial intelligence according to an embodiment of the present invention.
2 is a flowchart of a method for preventing theft and notifying a cargo loading location by onboard vehicle artificial intelligence facial recognition according to an embodiment of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in specific contents for practicing the invention. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like reference numerals have been used for like elements throughout the description of each figure.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block configuration diagram of an apparatus for preventing theft and notifying a cargo loading location based on facial recognition of a vehicle artificial intelligence according to an embodiment of the present invention.

Referring to FIG. 1 , an apparatus for preventing theft and notifying a loading location of a cargo by AI facial recognition onboard vehicle according to an embodiment of the present invention includes a barcode scanner module 100, a fisheye camera module 200, a theft detector 300, Driver's seat communicator 400, speaker module 500, LED module 510, door open sensor 600, occupancy sensor 610, acceleration sensor 620, carbon dioxide detection sensor 700, sensor controller 800 can be configured to include

Hereinafter, a detailed configuration will be described.

The barcode scanner module 100 may be configured to scan the barcode of the shipping box 1 when a box truck is stored and loaded and shipped.

The fisheye camera module 200 may be configured to photograph the driver and the delivery box 1 at the rear when warehousing, loading, and shipping. The fisheye camera module 100 may be installed at the top of the loading area of the vehicle to take pictures toward a door.

The theft detector 300 uses the barcode scanned by the barcode scanner module 100 and the driver and the delivery box 1 photographed by the fisheye camera module 200 to detect theft of the delivery box in real time, and the detection result in real time In case of theft of the shipping box, it may be configured to notify in real time of the theft of the shipping box.

The driver's seat communicator 400 may be configured to receive a real-time notification of the theft detector 300 and transmit a real-time notification result to the driver's smart phone 10 in real time.

The speaker module 500 may be configured to be provided in a driver's seat of a vehicle.

The LED module 510 may be configured to be provided in a driver's seat of a vehicle.

The door open sensor 600 may be configured to detect an open rear door of the vehicle.

The occupancy sensor 610 may be configured to detect whether a driver is occupied in the driver's seat of the vehicle.

The acceleration sensor 620 may be configured to detect whether or not the vehicle is running.

The carbon dioxide detection sensor 700 may be configured to detect the amount of carbon dioxide in the driver's seat of the vehicle.

When the door open sensor 600 detects the rear door open, the occupancy sensor 610 detects the driver's occupancy, and the acceleration sensor 620 detects the operation of the vehicle, the sensor controller 800 uses the speaker module 500 ) It may be configured to output a warning phrase and turn on the LED module 510 through. Through this, it is possible to prevent the vehicle from operating with the door of the rear loading area open.

In addition, the sensor controller 800 may be configured to output a warning message through the speaker module 500 and turn on the LED module 510 when the carbon dioxide detection sensor 700 detects a carbon dioxide amount equal to or greater than a predetermined standard. If the amount of carbon dioxide is too high, it may be configured to warn the driver.

Hereinafter, the theft detector 300 will be described in more detail.

The theft detector 300 includes a barcode recognition module 301, a face recognition module 302, a shipping box recognition module 303, a shipping box tracking module 304, a shipping box location specific module 305, and data storage for each shipping box. It may be configured to include a module 306, a barcode/face verification module 307, and a data storage control module 308 for each delivery box.

Hereinafter, a detailed configuration will be described.

The barcode recognition module 301 may be configured to recognize barcodes scanned by the barcode scanner module 100 .

The face recognition module 302 may be configured to recognize the driver's face photographed by the fisheye camera module 200 .

The delivery box recognition module 303 may be configured to recognize the shape of the delivery box 1 photographed by the fisheye camera module 200 .

The delivery box tracking module 304 may be configured to track the 3D location of the delivery box 1 recognized by the delivery box recognition module 303 in the loading space of the vehicle.

The delivery box position specification module 305 may be configured to specify the loading position of the delivery box 1 in 3D space according to the tracking result of the delivery box tracking module 304 .

The data storage module 306 for each shipping box includes the barcode information of the shipping box 1 recognized by the barcode recognition module 301, the face recognized by the face recognition module 302, and the shipping box location specified by the module 305. The loading position of the shipping box 1 may be configured to be stored.

When a barcode is recognized by the barcode recognition module 301, the barcode/face identification module 307 includes the recognized barcode information, the driver's face recognized by the face recognition module 302 at the time of recognition, and the delivery box at the time of recognition. It may be configured to check the loading position of the delivery box 1 specified by the position specifying module 305 .

Here, the barcode information may include the ID and delivery address of the loading box 1.

Also, the barcode/face verification module 307 may be configured to check whether the barcode information identified above is stored in the data storage module 306 for each delivery box.

At this time, when it is determined that barcode information is not stored in the data storage module 306 for each delivery box as a result of the check by the barcode/face verification module 307, the data storage control module 308 for each delivery box stores the corresponding barcode information, face And it may be configured to control to store the loading position in the data storage module 306 for each delivery box.

And if the barcode information is stored as a result of the above check, the barcode/face verification module 307 matches the barcode information and the face with the barcode information and face stored in the data storage module 306 for each delivery box. It can be configured to determine whether or not. At this time, it is of course possible to check the face even in a state where the barcode is not recognized and determine whether it matches the driver's face.

Meanwhile, the barcode/face verification module 307 matches the barcode information and the driver's face identified by the barcode/face verification module 307 with the barcode information stored in the data storage module 306 for each delivery box and the driver's face. If it is determined not to, it may be configured to notify the driver's seat communicator 400 of the delivery box theft in real time. That is, it can be seen that a person other than the driver takes the delivery box 1.

The barcode/face verification module 307 determines that the barcode information and the driver's face identified by the barcode/face verification module 307 match the barcode information stored in the data storage module 306 for each delivery box and the driver's face. If determined, the barcode/face verification module 307 may be configured to extract the loading position of the delivery box 1 stored in the data storage module 306 for each delivery box and transmit the same to the driver's seat communicator 400 . That is, it can be seen that the driver normally delivers and releases the delivery box 1 from the vehicle.

At this time, the driver's seat communicator 400 may be configured to receive the loading position from the barcode/face verification module 307 and transmit it to the driver's smart phone 10 in real time.

2 is a flowchart of a method for preventing theft and notifying a cargo loading location by onboard vehicle artificial intelligence facial recognition according to an embodiment of the present invention.

Referring to FIG. 2 , the barcode scanner module 100 scans the barcode of the delivery box 1 when loading and unloading a box truck and shipping out (S101).

Next, the fisheye camera module 200 takes pictures of the driver and the delivery box 1 at the rear when warehousing and loading and shipping out (S102).

Next, the theft detector 300 detects theft of a delivery box in real time using the barcode scanned by the barcode scanner module 100 and the driver and delivery box 1 photographed by the fisheye camera module 200 ( S103).

Here, if the delivery box is stolen as a result of the real-time detection, the theft detector 300 notifies the driver's seat communicator 400 of the delivery box theft in real time (S104a).

Then, the driver's seat communicator 400 receives the real-time notification of the theft detector 300 and transmits the real-time notification result to the driver's smartphone 10 in real time (S105a).

On the other hand, if the delivery box is not stolen as a result of real-time detection, the theft detector 300 extracts the loading position of the delivery box 1 already stored in the theft detector 300 and transmits it to the driver's seat communicator 400 (S104b).

Then, the driver's seat communicator 400 receives the loading position and transmits it to the driver's smart phone 10 in real time (S105b).

Although described with reference to the above embodiments, those skilled in the art can understand that the present invention can be variously modified and changed without departing from the spirit and scope of the present invention described in the claims below. There will be.

100: barcode scanner module 200: fisheye camera module
300: burglar detector 301: barcode recognition module
302: face recognition module 303: shipping box recognition module
304: Shipping box tracking module 305: Shipping box location specific module
306: data storage module for each shipping box 307: barcode/face verification module
308: Data storage control module for each shipping box
400: driver's seat communicator 500: speaker module
510: LED module 600: door open sensor
610: occupancy sensor 620: acceleration sensor
700: carbon dioxide detection sensor 800: sensor controller

Claims (10)

A barcode scanner module 100 that scans the barcode of the delivery box 1 when the box truck is loaded and shipped and released;
A fisheye camera module 200 for photographing the driver and the delivery box 1 at the rear when the warehouse is loaded and the delivery is out;
Using the barcode scanned by the barcode scanner module 100 and the driver and delivery box 1 photographed by the fisheye camera module 200, the theft of the delivery box in the vehicle is detected in real time, and as a result of the real-time detection, theft of the delivery box a theft detector (300) for real-time notification of the theft of the shipping box;
And a driver's seat communicator 400 for receiving a real-time notification of the theft detector 300 and transmitting a real-time notification result to the driver's smartphone 10 in real time,
The theft detector 300,
A barcode recognition module 301 recognizing the barcode scanned by the barcode scanner module 100;
A face recognition module 302 for recognizing the driver's face photographed by the fisheye camera module 200;
A delivery box recognition module 303 for recognizing the shape of the delivery box 1 photographed by the fisheye camera module 200,
A delivery box tracking module 304 for tracking the 3D position of the delivery box 1 recognized by the delivery box recognition module 303 in the loading space of the vehicle;
A shipping box position specifying module 305 for specifying the loading position of the shipping box 1 according to the tracking result of the shipping box tracking module 304;
The barcode information of the shipping box 1 recognized by the barcode recognition module 301, the face recognized by the face recognition module 302, and the loading of the shipping box 1 specified by the shipping box position specifying module 305 It includes a data storage module 306 for each delivery box in which the location is stored,
The theft detector 300,
When the barcode is recognized by the barcode recognition module 301, the recognized barcode information, the driver's face recognized by the face recognition module 302 at the corresponding recognition time, and the delivery box location specifying module 305 at the corresponding recognition time A barcode/face verification module 307 that checks the loading position of the delivery box 1 specified by and checks whether or not the checked barcode information is stored in the data storage module 306 for each delivery box;
As a result of checking by the barcode/face verification module 307, when it is determined that barcode information is not stored in the data storage module 306 for each delivery box, the corresponding barcode information, face, and loading position are stored in the data storage module for each delivery box. (306) The anti-theft and cargo loading position notification device by artificial intelligence facial recognition, characterized in that it is configured to further include a data storage control module (308) for each shipping box that is controlled to be stored.
According to claim 1,
a speaker module 500 provided in a driver's seat of the vehicle;
an LED module 510 provided in the driver's seat of the vehicle;
a door open sensor 600 for detecting an open rear door of the vehicle;
an occupancy sensor 610 for detecting whether a driver is occupied in the driver's seat of the vehicle;
an acceleration sensor 620 that detects whether the vehicle is running;
When the rear door open is detected by the door open sensor 600, the occupancy of the driver is detected by the occupancy sensor 610, and the operation of the vehicle is detected by the acceleration sensor 620, the speaker module 500 The anti-theft and cargo loading position notification device by AI facial recognition onboard vehicle, characterized in that it is configured to further include a sensor controller 800 for outputting a warning message and turning on the LED module 510 through.
According to claim 2,
It is configured to further include a carbon dioxide detection sensor 700 for detecting the amount of carbon dioxide in the driver's seat of the vehicle,
The sensor controller 800,
When the amount of carbon dioxide above a predetermined standard is detected by the carbon dioxide detection sensor 700, a warning message is output through the speaker module 500 and the LED module 510 is turned on. Anti-theft by recognition and notification of cargo loading location.
delete delete The method of claim 1, wherein the barcode/face verification module 307,
As a result of the check by the barcode/face verification module 307, when it is determined that barcode information is stored, the checked barcode information and face are the same as the barcode information and face stored in the data storage module 306 for each delivery box, respectively. An anti-theft and cargo loading location notification device by artificial intelligence facial recognition on board, characterized in that it is configured to determine whether they match each other.
The method of claim 6, wherein the barcode/face verification module 307,
If it is determined that the barcode information and the driver's face identified by the barcode/face verification module 307 do not match the barcode information stored in the data storage module 306 for each delivery box and the driver's face, the delivery box is stolen. is notified in real time to the driver's seat communicator 400,
When it is determined that the barcode information and the driver's face identified by the barcode/face verification module 307 match the barcode information and the driver's face stored in the data storage module 306 for each delivery box, each delivery box Anti-theft and cargo loading location notification device by onboard vehicle artificial intelligence facial recognition, characterized in that configured to extract the loading position of the shipping box 1 stored in the data storage module 306 and transmit it to the driver's seat communicator 400 .
The method of claim 7, wherein the driver's seat communicator 400,
An anti-theft and cargo loading position notification device by artificial intelligence facial recognition onboard vehicle, characterized in that configured to receive the loading position and transmit it to the driver's smartphone (10) in real time.
delete delete

Images