KR20210004556A - Detection System for Lost Object Using artificial intelligence in Vehicle and Detection Method Using the Same - Google Patents

Abstract

Disclosed are a detection system for a lost object in a vehicle and a lost object detection method using the same. The detection system for a lost object comprises: a processor for comparing image information and calculating the presence and type of residual detection; a determination unit having an artificial intelligence library of comparison, detection, and type determination; a memory unit storing information of the image, comparison, and detection type determination; a communication unit transmitting the image and information to a control center or a server; a lighting lamp for obtaining a video image with a small deviation; an alarm unit which can be recognized from a distance that the user can recognize from the vehicle; a lens + filter + image sensor unit acquiring an image in the vehicle; a power supply unit supplying power to the detection system for a lost object in a vehicle (100); and a control server (200) receiving related information from the device and interworking with a user-specific database.

Description

Detection System for Lost Object Using artificial intelligence in Vehicle and Detection Method Using the Same}

The present invention relates to a system for detecting a lost item in a vehicle using artificial intelligence and a method for detecting a lost item using the same.

The service for sharing vehicles using social relationship services is expanding and expanding. Unlike the existing rental car service, which moves to a parking lot that manages the vehicle and returns the vehicle, the vehicle sharing service has little or no face-to-face contact between the driver and the manager.

Moreover, in most cases, there is no person who manages the vehicle at all times, and the next user directly uses the vehicle after the user has finished using the vehicle. Recently, in order to prevent the occupant from leaving the vehicle while leaving the vehicle, a lost-and-found system has been proposed that detects an object located in the vehicle and informs the vehicle before getting off. Notification systems are also being proposed. (Registration Patent 10-1841948, Lost and Found in Vehicle Prevention Service Provision Device, Provision Method and Mobile Terminal, LG Electronics Co., Ltd.)

Nevertheless, although the existing method judges the existence of a lost item, it is difficult to determine whether it is a lost item or an item that the driver intentionally discarded and needs to be cleaned.

The present invention provides an alarm to the control center and related persons by determining whether the remaining in the vehicle is a lost item or a residue that needs to be cleaned, thereby preventing the occurrence of in-vehicle lost and found in-vehicle lost and found detection systems using the same and Its purpose is to provide a method.

In addition, the present invention detects the residuals owned by the driver or occupant in the vehicle, and informs the vehicle control center and related persons such as the final driver and passengers whether or not there is a lost item, or an artificial vehicle that informs the vehicle control center of a condition requiring cleaning. It is an object of the present invention to provide a system for detecting a lost item in a vehicle using intelligence and a method for detecting a lost item using the same.

In an embodiment of the present invention, an in-vehicle lost-and-place detection system using artificial intelligence includes a sensor unit for detecting an object inside a vehicle, and detects the object, not the structure of the vehicle itself, and detects the object according to a pre-learned feature. A processor that generates state information, and the processor generates and stores state information of the object in the vehicle so that at least two or more of the object's location, type, and object detection time point are displayed, and an alarm unit is notified. It is characterized in that it is formed to control the method.

In addition, the in-vehicle lost-and-place detection system using artificial intelligence according to an embodiment of the present invention detects a sensor unit for detecting an object inside the vehicle and a characteristic of the detected object. And a storage unit that determines whether water is water, stores the state information of the object in the vehicle as an image, and stores the determined state details.

In addition, the method for detecting a lost item in a vehicle according to an embodiment of the present invention stores at least one image inside the vehicle without residual objects, and stores at least one image inside the vehicle after the vehicle is turned off and the occupant gets off. The step of comparing the image inside the vehicle without the residue and the image inside the vehicle after the vehicle is turned off and the occupant gets off the vehicle to determine whether or not there is a residue inside the vehicle after the vehicle is turned off and the occupant gets off the vehicle, And determining whether the residue is a lost item or a residue to be cleaned, and providing an alarm to a control center and related persons through wireless communication according to a result of the determination.

According to the lost item detection system in a vehicle using artificial intelligence of the present invention and a lost item detection method using the same, by notifying the vehicle user's lost item to the vehicle manager and control center, and notifying the vehicle user of the lost item or managing the lost item. The service quality of the vehicle sharing service can be improved.

In addition, according to the in-vehicle lost and found detection system using artificial intelligence of the present invention and the lost and found method using the same, the vehicle manager and the control center identify the cleaning state that occurs due to the carelessness of the vehicle user, and clean the vehicle at an appropriate time. The service quality of the vehicle sharing service can be improved through removal, etc.

1 is a block diagram of a system for detecting a lost item in a vehicle using artificial intelligence according to an embodiment of the present invention.
2 is an exemplary image photograph of the inside of a vehicle used in the system and detection method for detecting lost items in a vehicle using artificial intelligence of the present invention.
3 is another exemplary image picture of the inside of a vehicle used in the system and method for detecting lost items in a vehicle using artificial intelligence of the present invention.
4 is an example of an image pre-processed using a boundary line detection method to detect a residue in the image of FIG. 3.
FIG. 5 is an image photograph of an image used in the process of detecting a lost item of the present invention and an image of the image in the form of analyzing the image residue by an artificial intelligence library installed in the determination unit.

Hereinafter, a system and method for detecting a lost item in a vehicle using artificial intelligence of the present invention will be described in detail with reference to the accompanying drawings and embodiments.

First, an in-vehicle lost and found detection system and detection method using artificial intelligence according to an embodiment of the present invention will be described.

The vehicle described in the present specification may be a concept of a specific area including a desk and a stool, and a periphery of a car, an airplane, and a personal office. Preferably, it may be a concept of finding an object having a specific resolution or higher that is covered by the image sensor of the camera. Hereinafter, the concept includes a part or all of the front seats (driver's seat and passenger seat) and the rear seats of a passenger car, and may preferably specify a shared service that the driver and user change from time to time.

Vehicles described in this specification include an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, an electric vehicle using a secondary battery as a power source, and an electric vehicle using a hydrogen fuel cell. It may be a concept to include.

1 is a block diagram of a system for detecting a lost item in a vehicle using artificial intelligence according to an embodiment of the present invention.

Referring to FIG. 1, the in-vehicle lost and found detection system using artificial intelligence may include a service providing device for detecting and determining characteristics of a residual material and a communication device for mobile communication, and in some cases, a database of stored and processed images and determination results. Including a control center and a server to deliver to the user can be built-in.

First, the in-vehicle lost and found detection system 100 detects an in-vehicle object. At this time, the in-vehicle lost and found detection system 100 not only detects the residuals, but also detects the characteristics of the object and notifies the control center and the user of the state information of the in-vehicle object reflecting the characteristics. The quality of service can be improved by classifying the condition of the vehicle that needs cleaning. Herein, the residue refers to an operation of loss that the user unintentionally places and unloads in the vehicle and an operation of trash throwing that the user intentionally or unintentionally discards and unloads in the vehicle.

Also, the feature of the object includes the type and viewpoint of the object, and may be stored as feature information of at least one residual material that has been learned in advance.

In addition, the in-vehicle lost and found detection system 100 generally starts an operation in a state where the engine is turned off and the vehicle door is closed after getting off the vehicle. This is in order not to infringe on personal information such as portrait rights as users other than objects are photographed and stored without notice.

Referring to FIG. 1, the in-vehicle lost and found detection system 100 compares image information, and compares and detects the processor 110 that calculates the existence and type of residual detected objects, and has a determination unit having an artificial intelligence library of type determination. (130), a memory unit 120 for storing information on the image and comparison, detection type determination, a communication unit (wireless communication) 160 for transferring the image and information to a control center or server, and an image image with little deviation. A lighting lamp 170 to be acquired, an alarm unit 150 that can be recognized from a distance that a user can recognize from the vehicle, a lens + filter + image sensor unit 183, 182, 181 that acquires an image in the vehicle, and a vehicle A power supply unit 190 for supplying power to the lost and found detection system 100 and a control server 200 for receiving related information from the device and interworking with a database for each user are separately configured. It consists of a device capable of selectively transmitting a final result from the control server 200 to a mobile terminal 300 such as a user's mobile phone.

The processor receives an image of an in-vehicle object acquired through a lens-filter-image sensor unit, and performs an operation defined in an artificial intelligence library installed in the determination unit to determine the existence and characteristics of a residual on the image. In addition, the processor not only stores the existence, characteristics, and determination results of the acquired image and residuals in the memory, but also returns the determination information to the determination unit. In addition, the processor wirelessly transmits all or part of the image information and the determination value to the control server through the communication unit according to the determination information.

In addition, the processor turns on a lamp to acquire a more suitable image when acquiring the image, and turns off the lamp when image acquisition is complete.

In addition, the processor operates by receiving power input from the power supply unit, receiving information input from the determination unit, in particular, status information such as starting and turning off the vehicle, starting when necessary, and hibernating when unnecessary.

The control unit receives vehicle information such as vehicle start-up and door lock, and transfers the information to the determination unit, and the determination unit transmits the information to the processor to start and end the residual detection service.

The notification unit may perform a task of informing the driver of a state in which there is a lost item or a state to be cleaned according to the state of the vehicle input from the determination unit by voice or lighting.

The filter may use a bandpass filter having a specific wavelength to prevent the image from being saturated due to diffuse reflection according to the angle of sunlight. Referring to FIG. 2, the applied filter is a visible ray camera using an infrared cut filter, and it can be seen that image information is saturated due to diffuse reflection in the center. 3 is a camera to which a specific infrared bandpass filter is applied, and it can be seen that diffuse reflection by sunlight is reduced and saturation is reduced.

The illumination generates light of a wavelength that passes through a bandpass filter applied to the filter in order for the image sensor to acquire a clear image. In addition, the lighting enables a clear image to be acquired in an illuminance where it is difficult for a visible light camera to acquire an image due to low lighting such as at night or in an underground parking lot.

Referring to FIGS. 2 and 3, the lens-filter-image sensor may be a camera disposed on a ceiling surface of a vehicle to capture an image inside the vehicle. 2 is an image acquired using only a lens and an image sensor without using a lamp and a filter.

Such a camera may be a still image or video obtained by an image sensor. At this time, images of 1st, 2nd, or 1st and 2nd columns inside the vehicle may be simultaneously acquired by the angle of view of the lens.

4 is an example of an image pre-processed using a boundary line detection method to detect a residue in the image of FIG. 3. In this case, the figure created by sunlight in the lower part of FIG. 3 is seen as a residue in the lower part of FIG. 4. To remove this noise, a separate filter can be used or image correction can be performed.

FIG. 5 is an image photograph of an image used in the process of detecting a lost item of the present invention and an image of the image in the form of analyzing the image residue by an artificial intelligence library installed in the determination unit. In the image of FIG. 5, the color of the result is divided by category and colored. The left image of FIG. 5 is an image input to the processor by the lens-filter-image sensor, and the image on the side of FIG. 5 is an example of detecting, determining, and classifying residuals by a learned library installed in the determination unit. The red, green, yellow, and blue colors of the image are examples of classification in which residuals such as umbrellas, smartphones, wallets, plastic bags, etc. are found and classified by color according to the classification definition learned in advance by the determination unit.

What has been described above is only one embodiment for implementing the in-vehicle lost and found detection system and detection method according to the present invention, and the present invention is not limited to the above-described embodiment, but as claimed in the claims below. Without departing from the gist of the invention, anyone of ordinary skill in the field to which the present invention belongs will have the technical spirit of the present invention to the extent that various changes can be implemented.

100: In-vehicle lost and found detection system
110: processor
120: memory unit
130: judgment unit
150: notification unit
160: communication department
170: lighting lamp
190: power supply
200: control server

Claims (2)

A processor that compares image information and calculates the presence and type of residual detection objects,
A judgment unit having an artificial intelligence library of comparison, detection, and type judgment,
A memory unit for storing the image and information of the comparison and detection type determination,
A communication unit that delivers the image and information to the control center or server,
A lighting lamp for acquiring an image image with little deviation,
An alarm unit that can be recognized from a distance that the user can recognize from the vehicle,
A lens + filter + image sensor unit that acquires an image inside the vehicle,
In-vehicle lost and found detection system using artificial intelligence, characterized in that it comprises a power supply unit that supplies power to the in-vehicle lost and found detection system 100 and a control server 200 that receives related information from the device and interlocks with a database for each user. . Storing at least one image of the inside of the vehicle without any residue, and storing at least one image of the inside of the vehicle after the vehicle is turned off and the passenger gets off the vehicle;
Comparing the image inside the vehicle without the residue and the image inside the vehicle after the vehicle is turned off and the occupant gets off the vehicle, and determining whether the vehicle is left after the vehicle is turned off and the occupant gets off the vehicle; and
A method for detecting lost items in a vehicle using artificial intelligence, comprising determining whether the residue is a lost item or a residue to be cleaned, and providing an alarm to the control center and related persons through wireless communication according to the result of the determination. .

Images