DE102021119813A1 - Method for checking the occupancy of at least one interior of a motor vehicle - Google Patents

Abstract

The invention relates to a method for checking the occupancy of at least one interior (4) of a motor vehicle (2), in which a terminal (8) that is in wireless communication with the motor vehicle (2) searches for a specific object ( 14, 16, 18) in the motor vehicle (2), the at least one interior (4) of the motor vehicle (2) being detected by at least one sensor of the motor vehicle (2) and at least one image of the at least one interior (4) being recorded is checked on the basis of the at least one image whether the specific object (14, 16, 18) is arranged in the at least one interior (4) of the motor vehicle (2) or not, with information about whether the specific Object (14, 16, 18) in the at least one interior (4) is located or not, with the terminal (8) is displayed.

Description

The invention relates to a method for checking the occupancy of at least one interior of a motor vehicle and a system for checking the occupancy of at least one interior of a motor vehicle.

A method for determining and providing information for the transport of at least one object is from the publication DE 10 2011 016 641 A1 known.

The pamphlet DE 10 2015 003 934 A1 shows a motor vehicle with a display option in the trunk area.

A method for illustrating a space-saving arrangement of luggage in a given storage space is from the publication DE 10 2015 111 439 A1 known.

A method for managing loading of a hold is from the reference DE 10 2014 008 482 A1 known.

Against this background, it was an object to monitor an interior of a motor vehicle in a suitable manner.

This object is achieved by a method and a system having the features of the independent patent claims. Embodiments of the method and the system emerge from the dependent patent claims and the description.

The method according to the invention is for checking an occupancy of at least one interior of a motor vehicle, i. i.e. R. taking into account objects, e.g. objects that may be located therein, in which a terminal that is in wireless communicative connection with the motor vehicle searches for a specific object, e.g. object, in the motor vehicle is triggered, wherein the at least one interior of the motor vehicle by at least one sensor, i. i.e. R. recorded by at least one camera of the motor vehicle and/or in the motor vehicle or in its at least one interior, and at least one image of the at least one interior is recorded. On the basis of the at least one image, it is automatically analyzed and/or checked as to whether or not the object is arranged in the at least one interior of the motor vehicle. Furthermore, information about whether or not the specific object is located in the at least one interior space is displayed and/or presented by and/or with the terminal device. The terminal is usually located outside the motor vehicle when the search is initiated.

An application (application or app) is implemented on the end device, which is designed in one embodiment to control the at least one sensor for recording the at least one image and the at least one recorded image, e.g. with the help of artificial intelligence, by comparison with a To analyze database and / or a neural network.

The at least one sensor that is used in the method is designed as an optical sensor for detecting and/or recognizing a respective condition of the at least one interior space. The at least one sensor is designed, for example, as a camera, as an infrared sensor, as an ultrasonic sensor, as an X-ray sensor and/or as a laser sensor. In this case, different sensors can be used to detect the at least one interior space. Each of the sensors is designed to detect a current structure or a current state of the at least one interior and to record it in the at least one image. This at least one image shows the at least one interior according to a respective technology of the at least one sensor. The at least one image is automatically analyzed or evaluated to identify the specific object, with a check being made as to whether or not the specific object is depicted in the image.

In one embodiment, the at least one image of the at least one interior space recorded and/or captured by the at least one sensor, e.g. For example, a display panel or display of the terminal device, shown or displayed. The at least one image is at least one photo or a video made up of a number of consecutive images.

In this case, if the specific object is located in the at least one interior space, the specific object is marked on the at least one image, usually emphasized or clarified in a visually recognizable manner. If, on the other hand, the specific object is not found, this can be indicated on the at least one image by at least one symbol, e.g. also by a character string with letters, numbers and/or special characters, information about the fact that the specific object is not located in the at least one interior space and therefore in the motor vehicle being displayed.

The at least one interior of the motor vehicle is automatically analyzed, examined and/or monitored, with the at least one interior being automatically searched for the specific object or the at least one interior being searched for it.

Depending on the definition, it is possible with the method presented to obtain information about a state of the at least one interior space, i. H. its occupancy and / or loading by objects, and / or to monitor this at least one interior of the motor vehicle, it being possible in each case that it is automatically checked whether the specific object, usually an inanimate object or possibly a living animal, in it is available.

In one possible embodiment of the method, it is possible for the specific object to be searched for to be searched for and identified or recognized automatically by using artificial intelligence and/or a database. It is possible that at least some steps of the method presented here are carried out at least partially using artificial intelligence, which can be self-learning. It is conceivable here for the artificial intelligence to know a large number of objects and the appearance of a respective object. Alternatively or additionally, the large number of objects is also stored in the database using illustrations. In this case, an object, for example an object, is also assigned a name or designation, such an assignment being known to the artificial intelligence and/or stored in the database, it being possible for the artificial intelligence and the Database for identifying or recognizing objects cooperate, the database being accessible to artificial intelligence.

In a further refinement, it is possible for the artificial intelligence to be informed about new objects and their appearance using images and trained accordingly, it being alternatively or additionally possible to supplement the database with such new objects and their appearance using images . Since it is possible to inform the artificial intelligence about new objects and their appearance and/or to supplement the database accordingly, in one embodiment of the method it is u. It is also possible for a new or unknown object to be searched for in the at least one interior space that is not in the at least one interior space or has ever been in it. It is thus possible to search for any desired object in the at least one interior space, and thus also for a new previously so-called unknown object, and to be able to provide information as to whether this specific object is located in the at least one interior space or not.

In one embodiment, an image search algorithm for recognizing or identifying objects is executed automatically and with software support by the application and/or the artificial intelligence. Alternatively or additionally, it is possible for such an image search algorithm to be carried out on the terminal device, in at least one computing unit in the motor vehicle and/or on an external server. The end device, the at least one computing unit and/or the server can interact with one another. Whether or not the at least one object is present in the at least one interior space is checked and/or monitored by the end device, the at least one computing unit of the motor vehicle and/or the server. It is possible for the server to have and/or provide the database and/or have access to it.

Irrespective of whether a check of the at least one interior based on the at least one image recorded by the at least one sensor, e.g. or is carried out by the server, with artificial intelligence being used in one embodiment, a result of a check and/or search of the at least one interior space is displayed in a visually visible manner on the terminal device, usually on its display panel or display. The at least one image, which the camera as a sensor records of the at least one interior, for example, is analyzed with regard to a possible presence of the object by the terminal device or its processing unit, the processing unit of the motor vehicle and/or the server. It is possible here for the at least one image from the at least one sensor, e.g Interior is located or not, usually based on the computing unit of the terminal is displayed directly on the display panel. If the at least one image is analyzed alternatively or additionally by the computing unit of the motor vehicle and/or by the server, information determined in the process as to whether the specific object to be searched for is in the at least one interior and/or the at least one marked image transmitted from the processing unit and/or the server to the end device and usually displayed in a visually recognizable manner on its display panel.

In one conceivable embodiment of the method presented, an occupancy history or loading history of the at least one interior of the motor vehicle with objects is taken into account. It is possible here for the camera to take the at least one image of the at least one interior after it has been opened and until this at least one interior has also been closed again. The at least one camera for recording the image of the at least one interior is activated when, for example, a closure element of this at least one interior, e.g. a flap and/or a door, e.g. a side door or rear door, is opened, with the at least an interior space is thus accessible from the outside. In one embodiment, the at least one camera is deactivated again as soon as the at least one interior space is closed again. If the at least one interior space is accessible from the outside, it is possible for at least one object to be placed in or removed from it. It is possible that the at least one camera is activated directly after opening the at least one interior and takes at least a first image of the at least one interior. As soon as the at least one interior space is closed again, at least one second image is recorded by the at least one camera. It is possible that at least one further image, e.g. a video, is recorded between the at least one first image and the at least one second image, while the at least one interior space is open and accessible from the outside, e.g. at regular intervals Intervals, e.g. on the order of a single-digit number of seconds, e.g. every second or every nth second, where n is an integer, maximum 10. The at least one first image and the at least one second image as well as the at least one additional image recorded in between are compared with one another, e.g. using artificial intelligence and/or the image search algorithm. It is possible to generate the intended occupancy history of the at least one interior space, regardless of whether a specific object is actually being searched for. It is thus possible to determine or determine which objects are located in the at least one interior space at a specific point in time, ie when the specific object is being searched for. It is also possible that a specific object that is covered by at least one other object can also be taken into account when a specific search is made for this specific object. If the particular object that is explicitly searched for is present in the at least one indoor space, but is obscured therein by other objects during a search for it, it is still possible to make a statement about it and to inform accordingly whether it is is located in the at least one interior space or not. If the specific object is located in the at least one interior under this condition, it is possible to display this on the at least one image that is displayed with the terminal device, for example as a dashed line and thus as being present there but covered by other objects to mark.

The at least one interior of the motor vehicle that is examined as part of the method is, for example, a loading space, such as a trunk, and/or at least one passenger compartment or passenger cell of the motor vehicle, in which there are occupants of the motor vehicle, but also objects, e.g .Objects located. With the method it is possible to monitor only one interior space or several interior spaces of the motor vehicle and to check whether the specific object is located therein. If the search for the specific object is triggered, it is possible to initially restrict this search to just one specific interior space among several interior spaces of the motor vehicle, with the end device usually specifying which interior space is to be searched and/or checked or . shall be.

The system according to the invention is designed to monitor the occupancy of at least one interior of a motor vehicle, the system having at least one sensor, for example at least one camera, which can also be designed as a component of the motor vehicle, at least one computing unit and a terminal. In this case, the end device, which is in wireless communication with the motor vehicle, the at least one sensor and the at least one computing unit, can initiate or initiate a search for a specific object, e.g. an object, in the motor vehicle, with the end device initiates such a search. The at least one sensor, for example a camera, is designed to optically record the at least one interior of the motor vehicle. The at least one computing unit is designed to analyze and/or check whether the specific object sought is located in the at least one interior of the motor vehicle or not. The end device is designed to display or display information about whether or not the specific object is located in the at least one interior space.

The at least one processing unit of the system presented here is arranged in the motor vehicle or designed as a component of the motor vehicle, arranged in an external server or designed as a component of this server and/or which is arranged in the terminal. Accordingly, depending on the definition, the system has the server with the at least one processing unit, the at least one processing unit in the motor vehicle and/or also the terminal with the at least one processing unit. Irrespective of where the at least one computing unit is arranged, it is designed to automatically search for, identify or recognize and/or name the at least one specific object in the at least one interior space with the aid of software.

In a further refinement of the system, it is provided that the motor vehicle, e.g. the at least one camera as the sensor of the motor vehicle and/or the computing unit of the motor vehicle, the terminal device and also the server each have at least one communication module for the wireless, e.g. radio-supported, exchange of information exhibit. It is possible for the at least one camera to be controlled directly by the end device to search for the specific object, with the end device requesting the at least one image of the at least one interior space from the camera, with the at least one camera sending the at least one image to the Terminal transmitted as soon as it has recorded this.

An application or application (app) for carrying out an embodiment of the presented method is installed on the terminal device. It is possible that the terminal can also be used independently of the motor vehicle and the method presented. The end device is, for example, designed or can be designated as a portable computer, such as a smartphone, and is also designed to be connected to any other components of the system, i. H. with the processing unit in the motor vehicle and/or the server i. i.e. R. wirelessly and thus radio-supported, e.g. via Bluetooth or near field communication (near field communication, NFC) and to exchange the information required to carry out the method about a possible presence of the specific object in the at least one interior of the motor vehicle.

It is possible for an embodiment of the method presented here to be carried out with an embodiment of the system presented here. With the method and/or the system it is i.a. possible to carry out a search function and monitoring function for the at least one interior of the motor vehicle, with the at least one object being automatically searched for in the at least one interior. The search for the at least one object and/or a corresponding check of the at least one interior is possible by using the end device, which communicates with at least the at least one camera and/or the computing unit of the motor vehicle, even from a great distance if a user of the Motor vehicle that has already left, but now wants to know whether the specific object is in the motor vehicle or not.

With the method and/or system, the user, e.g Image on the end device, usually using the application (app) displays and thus illustrates. The user is thus supported by the method and/or system in his search for the specific object. If, for example, a certain item is missing as an object and it is unclear whether it is still in the motor vehicle or not, if, for example, a child should miss its cuddly toy as a specific item, this specific item can also be left outside the motor vehicle under use to conveniently check the method and/or the system without having to go to the motor vehicle yourself and check for yourself whether the specific object is in the motor vehicle or not and, if necessary, having to determine it, that the specific object is not in the motor vehicle.

The search for the specific object can be carried out by the user using the image search algorithm and/or the artificial intelligence when the method is carried out. In such a search using the image search algorithm and/or the artificial intelligence, the at least one image can be opened on the end device, e.g. smartphone, and the object can be marked accordingly on the at least one image if it is located in the at least one interior space. If this is not the case, the user is provided with the terminal with corresponding information about the non-existence of the specific object sought in the motor vehicle. In an embodiment of the method, a search is made automatically for the specific object using a plurality of sensors, for example cameras, of the motor vehicle and/or in the motor vehicle in the at least one interior of the motor vehicle. Such an interior space can be subdivided. In one possible embodiment, it is also conceivable to use the method and/or the system, e.g. in summer, to search for a pet as an object in the at least one interior and to check whether the pet might have been left in the motor vehicle for a short time is.

It goes without saying that the features mentioned above and those still to be explained below can be used not only in the combination specified in each case, but also in other combinations or on their own, without departing from the scope of the present invention.

The invention is shown schematically on the basis of embodiments in the drawing and is described schematically and in detail with reference to the drawing.

1 shows a schematic representation of an example of a motor vehicle and an embodiment of the system according to the invention for carrying out an embodiment of the method according to the invention.

This in 1 The motor vehicle 2 illustrated by way of example comprises an interior 4 which is designed as a passenger compartment or passenger compartment or passenger cell or as a loading space for transporting objects 14, 16, 18, for example objects, with the motor vehicle 2. A plurality of objects 14 , 16 , 18 are arranged in the interior 4 and are therefore located in the interior 4 .

At least one camera 6 is assigned to this interior space 4 as an optical sensor, which is designed to capture the interior space 4 optically. In addition, the motor vehicle 2 also has a computing unit 7 .

1 FIG. 1 also shows a terminal 8 which is designed for data processing and radio-based communication. In this case, this terminal device 8 also includes a display field 10 or a display for optically displaying a display content, in addition to a further processing unit not shown in any more detail here.

It is possible for the at least one camera 6 for monitoring the interior 4 of the motor vehicle 2 and the computing unit 7 of the motor vehicle 2 as well as the usually mobile and portable end device 8 to be embodied as components of the embodiment of the system according to the invention, with this embodiment of the system the embodiment of the method according to the invention is carried out. It is possible that the above and in 1 Schematically illustrated components can also be used independently of the presented system and the method for other measures.

In the embodiment of the method, it is provided that a user, for example the driver, of the motor vehicle 2 wants to check whether a specific object 16 is located in the interior 4 of the motor vehicle 2 or not. This is also possible when the user is located at any distance outside of the motor vehicle 2 with the end device 8 he is using. To check whether this specific object 16 is in the interior 4, the embodiment of the method is triggered using the terminal 8, with a corresponding request to search for the specific object 16 starting from the terminal 8 via a communication link 12 to the motor vehicle 2 and thus to its camera 6 and/or processing unit 7.

To check the possible presence of the specific object 16 in the interior 4, the at least one camera 6 takes at least one image or photo, e.g. a static image or photo or several, e.g. moving images and accordingly a video of the interior 4 added. In the embodiment of the method, it is now possible for the at least one image to already be evaluated by the processing unit 7 in the motor vehicle 2 and transmitted to the terminal device 8 . Alternatively or additionally, it is possible for the at least one image to be transmitted from the camera 6 via the communication connection 12 directly to the terminal device 8 and evaluated there by its computing unit.

Irrespective of which at least one computing unit the at least one image of the interior 4 is or has been evaluated by, it is optically displayed for the user on the display panel 10 of the terminal device 8 . Here, the display panel 10 shows a of the first object 14 and a of the second object 18, both of which are located in the interior space 4. In addition, the display panel 10 shows a of the specific object 16 explicitly searched for by the user, this object 16 being replaced by the marked and thus compared to the other objects 14, 18 and the , is optically highlighted for this purpose, with the user being shown in a visually recognizable manner that the specific object 16 he is looking for is located in the interior 4. If the specific object 16 the user is looking for is not located in the interior 4 of the motor vehicle 2 , he is informed accordingly by the terminal 8 or that it is not present.

Reference List

2

motor vehicle

4

inner space

6

camera

7

unit of account

8th

end device

10

display panel

12

communication link

14, 16, 18

object

114, 116, 118

Illustration

QUOTES INCLUDED IN DESCRIPTION

This list of documents cited by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent Literature Cited

• DE 102011016641 A1 [0002]
• DE 102015003934 A1 [0003]
• DE 102015111439 A1 [0004]
• DE 102014008482 A1 [0005]

Claims (10)

Method for checking the occupancy of at least one interior (4) of a motor vehicle (2), in which a terminal (8) that is in wireless communication with the motor vehicle (2) searches for a specific object (14, 16, 18) is triggered in the motor vehicle (2), wherein the at least one interior (4) of the motor vehicle (2) is detected by at least one sensor of the motor vehicle (2) and at least one image of the at least one interior (4) is recorded, wherein on Based on the at least one image, it is checked whether the specific object (14, 16, 18) is located in the at least one interior (4) of the motor vehicle (2) or not, with information about whether the specific object (14, 16, 18) in the at least one interior space (4) or not, is displayed with the terminal (8). procedure after claim 1 , in which the at least one image of the at least one interior (4) is transmitted to the terminal (8) and displayed on the terminal (8). procedure after claim 1 or 2 , in which, if the specific object (14, 16, 18) is located in the at least one interior space (4), the specific object (14, 16, 18) is marked on the image. Method according to one of the preceding claims, in which the at least one interior (4) of the motor vehicle (2) is examined, the at least one interior (4) being automatically searched for the specific object (14, 16, 18). Method according to one of the preceding claims, in which the specific object (14, 16, 18) is searched for automatically by using artificial intelligence and/or a database. System for controlling an occupancy of at least one interior (4) of a motor vehicle (2), the system having at least one sensor, at least one computing unit (7) and a terminal (8), wherein the terminal (8) in wireless communicative Connection to the motor vehicle (2) with which there is at least one sensor and with the at least one computing unit (7), a search for a specific object (14, 16, 18) in the motor vehicle (2) is to be triggered, the at least one sensor is designed to optically detect the at least one interior (4) of the motor vehicle (2), the at least one computing unit (7) being designed to check whether the specific object (14, 16, 18) in the at least an interior (4) of the motor vehicle (2) is arranged or not, the terminal (8) being designed to provide information as to whether the specific object (14, 16, 18) is located in the at least one interior (4). or not to show. system after claim 6 , in which the at least one computing unit (7) is designed to automatically identify the specific object (14, 16, 18) in the at least one interior space (4) with the aid of software. system after claim 6 or 7 , In which on the terminal (8) an application for performing an embodiment of the method according to one of Claims 1 until 5 is installed. system after claim 6 until 8th , In which the motor vehicle (2) and the terminal (8) each have a communication module for exchanging information. system according to one of the Claims 6 until 9 , in which the at least one sensor is designed as a camera (6).

Images